External Collaboration
This page provides details for Loma Linda University students or faculty interested the use AHS-2 data for research.
Note: This page is intended to be informative, not definitive. The official reference regarding this process is the Guidelines for External Collaborators
document.
Overview
Pre-Approval
| Applies to: | Action | Item |
|---|---|---|
| @lightblue: All | Read | Guidelines for External Collaborators |
| @lightblue: All | Submit | Letter of intent to AHS-2 (via email) |
| @lightblue: All | Submit | Study Proposal |
| @lightgray:Study Proposal Approved | ||
| @lightblue: All | Contact | Assigned AHS-2 Investigator |
| @lightblue: All | Submit | Project schedule/timeline |
| @lightblue: All | Submit | Collaborative Agreement |
| @lightblue: All | Complete | Human Subjects Research training (e.g. CITI) |
| @lightblue: All | Submit | IRB Change Request Form |
| @lightgreen: Grant Writers | Submit | Draft of grant proposal (at least 6 weeks prior to due date) |
| @lightgreen: Grant Writers | Submit | Final grant proposal (at least 2 weeks prior to submission) |
| @lightblue: All | Submit | Detailed data request |
| @lightblue: All | Submit | Remote Access request |
| @lightgray:Analytic Dataset Provided | ||
| @lightblue: All | Submit | Analysis Plan |
| @lightblue: All | Submit | Progress reports (at least yearly) |
| @lightblue: All | Submit | Presentation of results |
| @lightblue: All | Submit | Analytic code for review / post-multiple imputation processing / regression calibration |
| @lightblue: All | Submit | Manuscript/Presentation/Abstract for review |
| @lightgray:Research Published/Presented |
Initiating AHS-2 Research
Official Guidelines Document
Researchers interested in AHS-2 research should read the official external collaboration guidelines, which contains additional information not included here. This document can be downloaded from the following link: Guidelines for External Collaborators: Use of the Adventist Health Study-2 Archived Data. Questions regarding the guidelines can be directed to AHS-2 by email or by phone.
Letter of Intent
Investigators wishing to develop a collaboration with the Adventist Health Study-2 (AHS-2) group to use the data archive are asked to initially e-mail a "letter of intent" to one or both of the AHS-2 Co-directors:
* Dr. Gary Fraser, AHS-2 Director ([email protected]
)
* Dr. Michael Orlich, Co-Director ([email protected]
)
It will be reviewed by Dr. Fraser and/or Dr. Orlich and the AHS-2 team of investigators at a regular monthly Coordinators’ Committee meeting.
Content
The letter of intent should briefly describe the nature of the proposed hypothesis.
Submission Deadlines
A letter of intent may be submitted at any time throughout the year.
Approval Criteria
The basic approval criteria for letter of intent are as follows:
* judged feasible (given database resources)
* has substantial scientific interest
* not currently being pursued by another investigator
* not currently under consideration (typically listed as a specific aim of a submitted or funded grant)
Feedback
It is also possible that the applicant will be asked to submit additional information, if it is unclear from the letter whether the research fulfills the requirements.
Approval Notification
The applicant will be notified of the decision within approximately 30 days after the letter of intent was submitted.
Study Proposal
Upon approval of the letter of intent, the applicant is asked to submit study proposal to the AHS-2 Proposal Review Committee (submit through Dr. Fraser or Dr. Orlich).
Content
The proposal should include the following:
* Rationale
* Hypothesis being proposed
* Scientific significance of the project
* Cohort participant data variables required for analysis
* Analysis of statistical power
* information required to support power calculations is available upon request
* Anticipated weaknesses/challenges
* Reasons for proposing use of AHS-2 data, rather than another source
* Study costs/funding overview
* Description of external collaboration team
* Curriculum vitae of collaboration team members
Length
The study proposal is requested to be 3-5 pages in length.
Approval Timeline
It is anticipated that the Proposal Review Committee’s decision will be made within four to eight weeks of proposal submission. The Review Committee decisions regarding proposals will be one of the following:
* Accept
* Accept pending revisions
* Reject
For either of the latter two outcomes, a summary of the reasons for the decision will be provided. An "accept pending revisions" will be given if the proposal has considerable scientific merit, yet one or more issues need to be addressed before the project can proceed. Arrangements will be made to provide an expedited review of a revised proposal, which addresses the concerns of the Review Committee.
Grant Application Timing
For proposals that will require the development of funding outside the proposing collaborator’s organization, the approval process described above must be factored into the timing of any grant application. The Review Committee and AHS-2 investigators cannot take responsibility for missed deadlines.
Available Data
AHS-2 data from the following sources may be available for approved collaborative research projects. More detailed descriptions of the available data variables will be provided upon approval of the letter of intent for help in crafting the project proposal.
* Baseline questionnaire data
* Calibration study data
* Biomarkers
* Outcome data (e.g., cancer incidence, mortality)
Obtaining AHS-2 Data
Assigned AHS-2 Investigator
If the proposal is approved, a primary AHS-2 investigator will be assigned to work with the external collaborator to facilitate the research.
Project Schedule / Timeline
At the beginning of a project, external collaborators should review with the AHS-2 a proposed schedule for project completion. Discussions of project timeline and progress will be primarily with the primary AHS-2 investigator involved in the collaboration, but will require review by Drs. Fraser or Orlich.
A proposed timeline for completion of projects should be discussed prior to submission of any grant (e.g. an NIH grant proposal). All projects need to be completed within the constraints of the current AHS-2 staffing levels. It is not possible to substantially increase (and then decrease) staffing levels for any single project.
Collaborative Agreement
The exact nature and scope of the project must be described in a written collaborative agreement and signed by the external collaborator and the assigned primary AHS-2 investigator.
The collaborative agreement is available for download here: Data Use Agreement for External Collaborators
Use of data from the AHS-2 cohort is limited to the defined, specific project for which approval was obtained. If further research or analytic activities develop from the original project, the external collaborator must obtain appropriate approval for such activities. In signing the agreement, external collaborators also will be confirming that they have read the guidelines outlined in this document and both understand and agree to comply with them.
Study Costs
Initial Costs
External collaborators must provide funds to cover the cost of initial programming by AHS-2 staff, needed to identify cases, exposure distributions or other related data if necessary.
Pilot Study Costs
Should substantial pilot research be needed, the cost of all pilot studies required to determine the feasibility and validity of the proposed project must be assumed by the external collaborator.
= AHS-2 Investigator Costs
Because of the complexity of the database and the AHS-2 investigators’ knowledge of the strengths as well as the limitations of these data, substantial input is required from AHS-2 investigators to insure both valid and maximal use of the available data. Therefore, at least one AHS-2 investigator must be included as a co-investigator on any grant proposal where use of AHS-2 data is proposed. Any non-academic outside user (e.g. from a private company) similarly must be able to provide salary support for an investigator. The level of effort will vary according to the size and complexity of the project but will be expected to range from 5% to 10% FTE per year. For more complex investigations, funding for an AHS-2 statistician may also be required.
Programmer Costs
To insure integrity of the AHS-2 data and comply with privacy commitments for our study participants, it is the policy of the AHS-2 that no data are copied from the Adventist Health Study-2 computer systems. Therefore, all analyses must be conducted on our computer system. It is possible for all programming to be done by the external collaborator or a designated person at the collaborating institution. The programmer would need to learn our computer system, data files, and analysis methods, which may require a visit to the Adventist Health Study-2 for an introductory session. The programmer will be issued a logon to the Adventist Health Study-2 computer for remote access. Even if outside collaborators do their own programming, some input from the Adventist Health Study-2 programmers is needed, and those costs must be covered by the outside collaborator. Alternatively, depending on the availability, the external collaborator may pay for the cost of having an AHS-2 programmer do all analyses. The cost is dependent upon the complexity of the investigation but is typically about 20% FTE.
Payment
The arrangement for payments will be through formal subcontracts with Loma Linda University School of Public Health, including full overhead.
Human Subjects Research Training
All investigators, external collaborators, consultants, and designated programmers/statisticians must complete a Human Subjects certification, such as the CITI course. For details regarding obtaining this certification, contact AHS-2 ([email protected]
).
IRB Approval
All projects must receive approval from the Loma Linda University Institutional Review Board prior to implementation. The preparation of the IRB application is primarily the responsibility of the external collaborators, in coordination with the primary collaborating AHS-2 investigator. Where the Proposals Review Committee determines that the proposed data use is in harmony with the original AHS-2 purpose and informed consent, the IRB application will be accomplished by filing a Change Request Form
.
External collaborators are also responsible for any IRB review or approval required by their home institution.
Grant Proposals
As necessary, an AHS-2 investigator and programmer will provide approximate case numbers, exposure distributions, and other related data that may be used for preparing a grant application. All costs for this effort must be borne by the collaborating outside investigator’s institution based on the time required to produce the data. No charge will be made for minimal effort.
Draft Proposals =
External collaborators must provide a draft of any grant proposal (e.g. NIH grant) to the collaborating AHS-2 investigator at least 6 weeks prior to the application due date. This will allow the AHS-2 investigator an opportunity to provide feedback, and will provide time to obtain any additional data, as noted above, that will maximize the probability of funding for the proposal.
Final Proposals
In keeping with the policies of Loma Linda University and the Adventist Health Study-2, the final grant proposal must be reviewed by Drs. Gary Fraser or Michael Orlich in the Adventist Health Study-2 and by the Associate Vice President for Research Affairs or his designee in Loma Linda University Research Affairs, at least 2 weeks before submission.
Failure to meet this deadline will result in delay of submission. This institutional policy also is followed by all AHS-2 investigators and cannot be circumvented. The primary AHS-2 investigator will provide a letter of support to the external collaborator to be included in the application, indicating the Adventist Health Study-2 group’s interest in collaborating on the proposed study.
Detailed Data Request
As a final step prior to the provision of an analytic dataset, a detailed data request should be prepared in consultation with the assigned AHS-2 investigator.
The assigned AHS-2 investigator will then submit the request to the AHS-2 programmers. Any modifications to the analytic dataset, such as additional variables or modified exclusion criteria, are to be requested through the assigned AHS-2 investigator.
Researchers making requests directly to the AHS-2 programmers will be referred to their assigned AHS-2 investigator.
Data Access
All primary data, computer programs, and analysis results must be maintained on the AHS-2 server, and all data analyses will be conducted on this or other linked in-house computers. SAS or R are typically the computer languages used for data analyses. If an external collaborator needs to use a different programming language, this must be discussed with the AHS-2 investigator before analyses begin.
Data Analysis and Publication
Analysis Plan and Procedure
The most efficient way for analyses to be accomplished will be for the external investigator and the collaborating AHS-2 investigator to agree on an analysis plan, including variables and covariates to be used, in advance (to whatever extent possible).
If analyses are being conducted by an AHS-2 programmer, the external collaborating investigator will provide a set of data analysis requests and a series of empty tables that indicate how the results are to be presented. In completing the analysis plan, the AHS-2 investigator will work as needed in supervising the AHS-2 programmer assigned to the project.
The external collaborating investigator should forward all analysis results to the AHS-2 investigator for review and discussion.
Progress Reports
The external collaborator must agree to keep the AHS-2 investigators updated on the progress of the study by providing a written progress report at least yearly. The progress report should include the following:
* Research Project Title
* Stage of progress (analyses, writing, first draft to all authors, internal revision, submitted, under revision, accepted for publication)
* Description of remaining tasks and updated timeline
Failure to adhere to a reasonable progress schedule (as assessed by the Proposals Review Committee) could lead to termination of the collaborative relationship with no further data tables or additional analyses provided and with permission to use already supplied data or analyses withdrawn.
Presentation of Results
When tables of results are finalized, these tables and a written abstract will be presented by the AHS-2 investigator at a regular AHS-2 study meeting. This provides an opportunity for other investigators to comment and make suggestions for improvement. Based on the comments, additional analyses may be required. Presentation of results at an AHS-2 study meeting is required for all research that uses AHS-2 data prior to submission for publication.
In addition, each external collaborator must notify the assigned AHS-2 investigator of any presentations (oral or written, formal and informal) using data from AHS-2 before the presentation is made.
Analytic Code Review/Processing
It is required that the code used for analysis must be carefully reviewed by an AHS-2 epidemiologist in addition to the study programmer/statistician and the external collaborating investigator.
Importantly, the sign off must be by an AHS-2 investigator who understands how the cases and population for analysis are being defined, is familiar with AHS-2 variable definitions, and can understand the code generated by the programmer.
Additionally, results derived from AHS-2 data often require post-processing by AHS-2 programmers to account for effects introduced by multiple imputation, and to perform regression calibration.
This computer code review is required for all investigations that use AHS-2 data.
The final computer code must be submitted to AHS-2 for documentation and future reference.
Final Pre-Publication Review
At least one member of the AHS-2 investigative team will be a coauthor on any abstract/presentation/manuscript resulting from this collaboration and, as such, will need to sign-off prior to its submission for publication or public presentation. All manuscripts must also be submitted for review to Drs. Fraser or Orlich, and approval must be obtained before a manuscript can be submitted to a journal for publication. This additional review is also required of all AHS-2 investigators.
Manuscript disputes
Any dispute regarding data interpretation may be brought to the full AHS-2 Coordinators’ Committee for consideration. Where appropriate, this Committee will seek additional consultation from independent experts. This committee may only be able to review such matters every 3-6 months, and so considerable delay in coming to a resolution could occur. Therefore, it behooves all collaborating investigators to work closely with the designated AHS-2 investigator in resolving any dispute. Final decisions rest with Drs. Fraser and Orlich.