iVDGL software is, for the most part, being developed under other funding by iVDGL participants and others. In particular, building on the Globus and Condor toolkits and incorporating pioneering new virtual data concepts, they are constructing the Virtual Data Toolkit (VDT), a software system for experimentation with virtual data con-cepts in large-scale Data Grid applications. However, that work (primarily GriPhyN) is not funded to produce pro-duction quality software or to support large-scale use by the substantial scientific communities that will use iVDGL. In addition, the unique nature of iVDGL will require the development of additional software components for the management of large-scale testbeds and for data collection during application experiments. Both software hardening and development will be addressed within iVDGL. Both activities have the potential to be tremendously demanding and the resources available here are unlikely to be sufficient to tackle them in their entirety. However, by providing staff dedicated to these tasks within iVDGL, by leveraging the participation of VDT developers and by integrating the support staff with the developers, we can provide VDT code with sufficient stability, scalability and support for everyday production use by application scientists.
Software development activities will be split across two teams: a VDT Robustification and Troubleshooting team (VRT) and a Large Scale Operations (LSO) team. To leverage GriPhyN funding and to maximize effectiveness and efficiency, the VRT will be led by GriPhyN VDT lead Miron Livny, and will include participation by USC and UWisc. The VRT will not develop new software but instead will work to enhance the releases of the GriPhyN VDT software, as follows: (1) develop and maintain a VDT test suite; (2) define and implement a unified and fully inte-grated error reporting framework across all VDT components; (3) equip the VDT with dynamically configurable event logging capabilities; (4) extend the VDT with new components required for specific application purposes; (5) help users to maintain and trouble shoot the VDT software, (6) provide documentation, and (7) create procedures and tools for reporting, tracking, and fixing bugs.
The LSO will be lead by Ian Foster and will have participants from U. Chicago and USC. The LSO will focus on the design and development of tools unique to iVDGL, relating particularly to testbed management, scalability, and usability issues that arise in iVDGL operation. These tools will ultimately transition to the iGOC and the LSO team will work in collaboration with the iGOC in software design and deployment. Issues to be addressed will include (1) development of automatic distribution and update services, (2) tools for testing iSite compliance with iVDGL configuration guidelines, (3) agent based monitoring and diagnostic tools for tracking overall iVDGL workflow, and (4) instrumentation and logging services for collecting and archiving long-term iVDGL performance metrics.