Risk of stroke after chiropractic spinal manipulation in medicare B beneficiaries aged 66 to 99 years with neck pain.
Journal: 2015/November - Journal of Manipulative and Physiological Therapeutics
ISSN: 1532-6586
Abstract:
OBJECTIVE
The purpose of this study was to quantify risk of stroke after chiropractic spinal manipulation, as compared to evaluation by a primary care physician, for Medicare beneficiaries aged 66 to 99 years with neck pain.
METHODS
This is a retrospective cohort analysis of a 100% sample of annualized Medicare claims data on 1 157 475 beneficiaries aged 66 to 99 years with an office visit to either a chiropractor or primary care physician for neck pain. We compared hazard of vertebrobasilar stroke and any stroke at 7 and 30 days after office visit using a Cox proportional hazards model. We used direct adjusted survival curves to estimate cumulative probability of stroke up to 30 days for the 2 cohorts.
RESULTS
The proportion of subjects with stroke of any type in the chiropractic cohort was 1.2 per 1000 at 7 days and 5.1 per 1000 at 30 days. In the primary care cohort, the proportion of subjects with stroke of any type was 1.4 per 1000 at 7 days and 2.8 per 1000 at 30 days. In the chiropractic cohort, the adjusted risk of stroke was significantly lower at 7 days as compared to the primary care cohort (hazard ratio, 0.39; 95% confidence interval, 0.33-0.45), but at 30 days, a slight elevation in risk was observed for the chiropractic cohort (hazard ratio, 1.10; 95% confidence interval, 1.01-1.19).
CONCLUSIONS
Among Medicare B beneficiaries aged 66 to 99 years with neck pain, incidence of vertebrobasilar stroke was extremely low. Small differences in risk between patients who saw a chiropractor and those who saw a primary care physician are probably not clinically significant.
Relations:
Content
Citations
(6)
References
(29)
Clinical trials
(1)
Diseases
(1)
Conditions
(1)
Organisms
(1)
Processes
(1)
Affiliates
(2)
Similar articles
Articles by the same authors
Discussion board
J Manipulative Physiol Ther 38(2): 93-101

Risk of Stroke Following Chiropractic Spinal Manipulation in Medicare B Beneficiaries Aged 66–99 Years with Neck Pain

Objective

The purpose of this study was to quantify risk of stroke following chiropractic spinal manipulation, as compared to evaluation by a primary care physician, for Medicare beneficiaries aged 66–99 years with neck pain.

Methods

This is a retrospective cohort analysis of a 100% sample of annualized Medicare claims data on 1,157,475 beneficiaries aged 66–99 years with an office visit to either a chiropractor or primary care physician for neck pain. We compared hazard of vertebrobasilar stroke and any stroke at 7 and 30 days following office visit using a Cox proportional hazards model. We used direct adjusted survival curves to estimate cumulative probability of stroke up to 30 days for the two cohorts.

Results

The proportion of subjects with stroke of any type in the chiropractic cohort was 1.2 per 1,000 at 7 days, and 5.1 per 1,000 at 30 days. In the primary care cohort, the proportion of subjects with stroke of any type was 1.4 per 1,000 at 7 days, and 2.8 per 1,000 at 30 days. In the chiropractic cohort, the adjusted risk of stroke was significantly lower at 7 days as compared to the primary care cohort (hazard ratio 0.39; 95% CI 0.33–0.45), but at 30 days, a slight elevation in risk was observed for the chiropractic cohort (hazard ratio 1.10; 95% CI 1.01–1.19).

Conclusions

Among Medicare B beneficiaries aged 66–99 with neck pain, incidence of vertebrobasilar stroke was extremely low. Small differences in risk between patients who saw a chiropractor and those who saw a primary care physician are probably not clinically significant.

INTRODUCTION

Risk of Stroke Following Spinal Manipulation

Manipulation of the cervical spine is a treatment for neck pain often performed by chiropractic physicians, but the safety of cervical spine manipulation has been questioned because observational studies have linked cervical spine manipulation to vertebral artery dissection and subsequent vertebrobasilar stroke (VBS).13 A considerable amount of controversy persists regarding the safety of cervical spine manipulation.4

VBS is an uncommon type of stroke, with a reported population incidence of 0.97 cases per 100,000.5 The likelihood of VBS following spinal manipulation has been examined in three studies employing case-control designs, an approach well suited to the evaluation of rare conditions such as VBS. Smith et. al. compared patients with ischemic stroke or transient ischemic attack, with and without vertebral artery dissection, and concluded that spinal manipulation is an independent risk factor for vertebral artery dissection.3 Rothwell et. al. studied 582 cases of VBS, and found that patients with stroke under 45 years of age were five times more likely than controls to have visited a chiropractor within one week of the stroke.2 Cassidy et. al. also found an increased association between chiropractic visits and VBA stroke in patients less than 45 years of age, but the association was no greater than that associated with visits to primary care physicians.1 Taken together, the results of these case-control studies constitute the strongest evidence regarding the association between spinal manipulation and VBS.

More subject to bias in favor of a stronger association with spinal manipulation was an observational study of 1,897 subjects conducted by Engelter et. al., who employed a questionnaire to assess for “prior cervical trauma”. Spinal manipulation was found to be a determinant of cervical (vertebral or carotid) artery dissection, but not an independent risk factor. 6 Also with greater potential for bias - in either direction – was the use of an ecological study design by Boyle et. al., who found that marked increases in the rates of VBS in two Canadian provinces in 2000 were unassociated with increased utilization of chiropractic services.7

Several recent systematic reviews on the safety of chiropractic care and spinal manipulation have been largely inconclusive with regard to risk of adverse events in general, and stroke in particular. In 2005 Rubinstein and colleagues evaluated risk factors for cervical artery dissection. They found strong associations for “trivial trauma” (including spinal manipulation), but conducted no meta-analysis. They urged caution with regard to attributing cervical artery dissection to spinal manipulation, pending further research.8 In 2007, in a systematic review on the adverse effects of spinal manipulation, Ernst concluded that spinal manipulation can cause vertebral artery dissection,9 but in 2012 a replication of that review found numerous errors and omissions that threatened its validity.10 A review of the safety of chiropractic interventions published in 2009 found no robust data on the incidence of adverse reactions after chiropractic care. Estimates of the risk of serious adverse events such as stroke ranged from 0.05 to 1.46 per 10,000,000 manipulations.11 A systematic review published in 2010 was also unable to draw any conclusions regarding the risk of adverse events associated with manipulation of the cervical spine for care of neck pain in adults.12 Similarly, a review published in 2012 found the evidence inadequate to either confirm or refute a significant association between manipulation of the cervical spine and stroke.13

Age as a Risk Factor for VBS Following Spinal Manipulation

Efforts to identify either risk factors or populations at risk for VBS have been largely unsuccessful.14,15 The risk of stroke in general increases with age,16 but it is not known how age might affect the risk of stroke following spinal manipulation.17 Current best knowledge of the risk of stroke temporally associated with spinal manipulation in older patients is based upon the work of Rothwell et. al. and Cassidy et. al., who collectively found only 53 patients over the age of 45 with stroke following spinal manipulation, out of a total of 1,400 cases of VBS.2,18 Rothwell et. al. analyzed 582 cases of VBS, and found no significant association between VBS and chiropractic care for those aged ≥45 years. Cassidy et. al. analyzed 818 cases of VBS, stratified by age, and also found no association between VBS and chiropractic care for those 45 years of age and older.1 Subsequently, Choi and colleagues examined patient demographic data in three case series and three surveys on characteristics of patients with stroke following spinal manipulation.17 Where reported, mean patient age in these studies ranged from 34.0 years (n=10)19 to 44 years (n=74).20 However, Choi et. al. found a population at risk that was significantly older than that previously reported: in a population-based case series of 93 patients with VBS who had visited a chiropractor in the previous year, mean patient age was 57.6 years.17

Risk of Stroke Following Chiropractic Spinal Manipulation in Elderly US Adults

No population based studies of risk of stroke following spinal manipulation have been conducted in the US, or focused upon older adults. In this study, we sought to answer the research question: “In Medicare beneficiaries aged 66–99 with neck pain, what is the probability of stroke following chiropractic spinal manipulation, as compared to a control group of subjects evaluated for neck pain by a primary care physician?” Among Medicare beneficiaries aged 66–99, we hypothesized no difference in risk of stroke between those exposed to chiropractic spinal manipulation for neck pain and those exposed to evaluation by a primary care physician for neck pain. Because chiropractors frequently treat neck pain with spinal manipulation, and the temporal association between provider office visits and stroke has been observed to be stronger in patients with neck pain,18 we limited our sample to beneficiaries with neck pain. (Choi and colleagues found that among 93 patients with VBS and a chiropractic visit within the previous year, the most common comorbidities (reported by 67%) were neck pain and headache.17) An understanding of the relationship between spinal manipulation and stroke among US Medicare beneficiaries should help facilitate the safe and appropriate utilization of chiropractic care for neck pain in older adults. Thus, the purpose of this study was to quantify risk of stroke following chiropractic spinal manipulation, as compared to evaluation by a primary care physician, for Medicare beneficiaries aged 66–99 years with neck pain.

Risk of Stroke Following Spinal Manipulation

Manipulation of the cervical spine is a treatment for neck pain often performed by chiropractic physicians, but the safety of cervical spine manipulation has been questioned because observational studies have linked cervical spine manipulation to vertebral artery dissection and subsequent vertebrobasilar stroke (VBS).13 A considerable amount of controversy persists regarding the safety of cervical spine manipulation.4

VBS is an uncommon type of stroke, with a reported population incidence of 0.97 cases per 100,000.5 The likelihood of VBS following spinal manipulation has been examined in three studies employing case-control designs, an approach well suited to the evaluation of rare conditions such as VBS. Smith et. al. compared patients with ischemic stroke or transient ischemic attack, with and without vertebral artery dissection, and concluded that spinal manipulation is an independent risk factor for vertebral artery dissection.3 Rothwell et. al. studied 582 cases of VBS, and found that patients with stroke under 45 years of age were five times more likely than controls to have visited a chiropractor within one week of the stroke.2 Cassidy et. al. also found an increased association between chiropractic visits and VBA stroke in patients less than 45 years of age, but the association was no greater than that associated with visits to primary care physicians.1 Taken together, the results of these case-control studies constitute the strongest evidence regarding the association between spinal manipulation and VBS.

More subject to bias in favor of a stronger association with spinal manipulation was an observational study of 1,897 subjects conducted by Engelter et. al., who employed a questionnaire to assess for “prior cervical trauma”. Spinal manipulation was found to be a determinant of cervical (vertebral or carotid) artery dissection, but not an independent risk factor. 6 Also with greater potential for bias - in either direction – was the use of an ecological study design by Boyle et. al., who found that marked increases in the rates of VBS in two Canadian provinces in 2000 were unassociated with increased utilization of chiropractic services.7

Several recent systematic reviews on the safety of chiropractic care and spinal manipulation have been largely inconclusive with regard to risk of adverse events in general, and stroke in particular. In 2005 Rubinstein and colleagues evaluated risk factors for cervical artery dissection. They found strong associations for “trivial trauma” (including spinal manipulation), but conducted no meta-analysis. They urged caution with regard to attributing cervical artery dissection to spinal manipulation, pending further research.8 In 2007, in a systematic review on the adverse effects of spinal manipulation, Ernst concluded that spinal manipulation can cause vertebral artery dissection,9 but in 2012 a replication of that review found numerous errors and omissions that threatened its validity.10 A review of the safety of chiropractic interventions published in 2009 found no robust data on the incidence of adverse reactions after chiropractic care. Estimates of the risk of serious adverse events such as stroke ranged from 0.05 to 1.46 per 10,000,000 manipulations.11 A systematic review published in 2010 was also unable to draw any conclusions regarding the risk of adverse events associated with manipulation of the cervical spine for care of neck pain in adults.12 Similarly, a review published in 2012 found the evidence inadequate to either confirm or refute a significant association between manipulation of the cervical spine and stroke.13

Age as a Risk Factor for VBS Following Spinal Manipulation

Efforts to identify either risk factors or populations at risk for VBS have been largely unsuccessful.14,15 The risk of stroke in general increases with age,16 but it is not known how age might affect the risk of stroke following spinal manipulation.17 Current best knowledge of the risk of stroke temporally associated with spinal manipulation in older patients is based upon the work of Rothwell et. al. and Cassidy et. al., who collectively found only 53 patients over the age of 45 with stroke following spinal manipulation, out of a total of 1,400 cases of VBS.2,18 Rothwell et. al. analyzed 582 cases of VBS, and found no significant association between VBS and chiropractic care for those aged ≥45 years. Cassidy et. al. analyzed 818 cases of VBS, stratified by age, and also found no association between VBS and chiropractic care for those 45 years of age and older.1 Subsequently, Choi and colleagues examined patient demographic data in three case series and three surveys on characteristics of patients with stroke following spinal manipulation.17 Where reported, mean patient age in these studies ranged from 34.0 years (n=10)19 to 44 years (n=74).20 However, Choi et. al. found a population at risk that was significantly older than that previously reported: in a population-based case series of 93 patients with VBS who had visited a chiropractor in the previous year, mean patient age was 57.6 years.17

Risk of Stroke Following Chiropractic Spinal Manipulation in Elderly US Adults

No population based studies of risk of stroke following spinal manipulation have been conducted in the US, or focused upon older adults. In this study, we sought to answer the research question: “In Medicare beneficiaries aged 66–99 with neck pain, what is the probability of stroke following chiropractic spinal manipulation, as compared to a control group of subjects evaluated for neck pain by a primary care physician?” Among Medicare beneficiaries aged 66–99, we hypothesized no difference in risk of stroke between those exposed to chiropractic spinal manipulation for neck pain and those exposed to evaluation by a primary care physician for neck pain. Because chiropractors frequently treat neck pain with spinal manipulation, and the temporal association between provider office visits and stroke has been observed to be stronger in patients with neck pain,18 we limited our sample to beneficiaries with neck pain. (Choi and colleagues found that among 93 patients with VBS and a chiropractic visit within the previous year, the most common comorbidities (reported by 67%) were neck pain and headache.17) An understanding of the relationship between spinal manipulation and stroke among US Medicare beneficiaries should help facilitate the safe and appropriate utilization of chiropractic care for neck pain in older adults. Thus, the purpose of this study was to quantify risk of stroke following chiropractic spinal manipulation, as compared to evaluation by a primary care physician, for Medicare beneficiaries aged 66–99 years with neck pain.

METHODS

The Dartmouth College Committee for Protection of Human Subjects reviewed and approved the research plan. This study was supported by the National Institutes of Health under Award Number K01AT005092.

Data Sources and Sampling

We conducted a retrospective cohort study using Medicare administrative data. Our data sources were 100% of Denominator files (for beneficiary demographics), Carrier files (for outpatient claims), and MEDPAR files (for inpatient claims) for the years 2006–2008. The data files were merged on unique beneficiary identifiers to generate the analytic files.

Cohort Definition

Each included beneficiary was assigned to one of two cohorts, in which beneficiaries with neck pain used either chiropractic care or primary care exclusively:

Chiropractic Cohort

Beneficiaries with at least one allowed Medicare B claim in 2007 for chiropractic office visit with spinal manipulation, identified as claim with provider specialty code #35, with CPT code for spinal manipulation (98940, 98941 or 98942), but without a primary care office visit for neck pain in 2007.

Primary Care Cohort

Beneficiaries with at least one allowed Medicare B claim in 2007 for primary care office visit for evaluation and management, but without a chiropractic office visit for neck pain in 2007. (Primary care visits were identified as claims associated with the provider specialty code for Family Medicine (08), Internal Medicine (11) or General Practice (01). Evaluation and management services were identified by BETOS Code “M”.

Exposures

We included all beneficiaries covered under the Medicare B fee for service plan, aged 66–99 and living as of Jan 1st of each year, with at least one allowed Medicare B claim in 2007 for an office visit associated with a diagnosis of neck pain to either a chiropractor or primary care physician. Neck pain was identified by any of the following ICD-9 codes: 721.0, 721.1, 722.0, 722.4, 722.71, 722.81, 722.91, 723.0, 723.1, 723.2, 723.3, 723.5, 723.7, 723.8, 723.9, 739.1, 756.16, 756.2, 839.00, 839.01, 839.02, 839.03, 839.04, 839.05, 839.06, 839.07, 839.08, 847.0, 953.0, or 953.4. We excluded duplicate claims for the same patient, provider, procedure and date of service. We also excluded beneficiaries with a previous history of cerebrovascular disease (in Part A or Part B data) at any time during the one-year period prior to the date of first exposure and accrual to cohort. Prior cerebrovascular disease was identified by any of the following codes for stroke (ICD-9 430, 431, 432–432.9, 433–433.9, 434–434.9, 436, 437.1, 443.21, 443.24 or 900–900.9), transient cerebral ischemia (ICD-9 435 – 435.9) or late effects of cerebrovascular diseases (ICD-9 438 – 438.9). A one-year look back window from first exposure to office visit for neck pain and accrual to cohort served to exclude beneficiaries with a recent history of cerebrovascular disease and to calculate Charlson co-morbidity scores for risk adjustment. [Figure 1] The Charlson co-morbidity index is a validated prognostic tool based upon the risk of mortality associated with a range of comorbid chronic diseases. For each patient, individual conditions are assigned scores, which are summed to provide a total score.

An external file that holds a picture, illustration, etc.
Object name is nihms646741f1.jpg

Cohort Accrual

Medicare allows coverage for chiropractic spinal manipulation of up to five spinal regions (cervical, thoracic, lumbar, sacral and pelvic). It is not possible to specifically identify manipulation of the cervical spine through analysis of Medicare data, because the procedure codes for chiropractic spinal manipulation identify the number of spinal regions manipulated but not the specific spinal regions at which the manipulations were performed. However, Medicare does require that the level at which the manipulation is performed must be tied to the patient’s complaint.21 Therefore, assuming compliance with Medicare clinical practice guidelines, a patient complaint of neck pain should be associated with the delivery of cervical spine manipulation.

Outcomes Measurement

The hazard (observation) period for identifying outcomes was a 30 day window following each exposure to an office visit for neck pain. We set the hazard period at 30 days to allow for comparison of our results with the findings of previous reports.1 The primary outcome measure was VBS within 30 days of office visit for neck pain. However, due to the potential for bias resulting from the imprecise use of diagnosis codes in claims data, we also analyzed for any type of stroke. We identified stroke by ICD-9 code 430, 431, 432–432.9, 433–433.9, 434–434.9, 436, 437.1, 443.21, 443.24, or 900–900.9, recorded in hospital emergency department or in-patient claims. We categorized strokes as VBS and non-VBS - identifying VBS by diagnosis code 433.00, 433.01, 433.20 or 433.21 - all other stroke codes were categorized as non-VBS. As a secondary outcome measure, among those diagnosed with stroke we also evaluated for death within 30 days of office visit. For each successive office visit, we evaluated for days to diagnosis of stroke, and censored the previous visit. Subjects were removed from follow-up upon occurrence of their first stroke. Evaluation of risk by office visit allowed comparison of risk between cohorts while allowing for the high degree of variability in number, frequency and timing of office visits. For analysis of hazard of stroke within 30 days, we excluded subjects who were hospitalized for stroke on the same day as the office visit, because these patients likely presented with signs or symptoms of stroke. [Figure 2] The data used in this study were analyzed in accordance with a data user agreement with The Centers for Medicare and Medicaid Services. Rules for the conduct of Medicare approved research projects stipulate that specific quantities may not be disclosed if the unit of observation contains fewer than eleven subjects.

An external file that holds a picture, illustration, etc.
Object name is nihms646741f2.jpg

Exclusions and Censoring

Analysis

We initially measured incidence of first stroke following exposure to office visit, and analyzed for 30-day mortality following stroke. We compared the hazard of stroke within 30 days between patients visiting chiropractors and those visiting primary care physicians, using a Cox proportional hazards model. The model was adjusted for subject age, gender, race and Charlson comorbidity index. We used the same approach to estimate the hazard ratio of stroke within the first 7 days (by right censoring all subjects at 7 days). To estimate the cumulative probability of stroke up to 30 days for the chiropractic and PCP groups while adjusting for the covariates stated above, we used direct adjusted survival curves, as described by Zhang and colleagues.22,23 We performed data analyses in SAS (SAS Institute Inc., Cary, North Carolina).

Data Sources and Sampling

We conducted a retrospective cohort study using Medicare administrative data. Our data sources were 100% of Denominator files (for beneficiary demographics), Carrier files (for outpatient claims), and MEDPAR files (for inpatient claims) for the years 2006–2008. The data files were merged on unique beneficiary identifiers to generate the analytic files.

Cohort Definition

Each included beneficiary was assigned to one of two cohorts, in which beneficiaries with neck pain used either chiropractic care or primary care exclusively:

Chiropractic Cohort

Beneficiaries with at least one allowed Medicare B claim in 2007 for chiropractic office visit with spinal manipulation, identified as claim with provider specialty code #35, with CPT code for spinal manipulation (98940, 98941 or 98942), but without a primary care office visit for neck pain in 2007.

Primary Care Cohort

Beneficiaries with at least one allowed Medicare B claim in 2007 for primary care office visit for evaluation and management, but without a chiropractic office visit for neck pain in 2007. (Primary care visits were identified as claims associated with the provider specialty code for Family Medicine (08), Internal Medicine (11) or General Practice (01). Evaluation and management services were identified by BETOS Code “M”.

Chiropractic Cohort

Beneficiaries with at least one allowed Medicare B claim in 2007 for chiropractic office visit with spinal manipulation, identified as claim with provider specialty code #35, with CPT code for spinal manipulation (98940, 98941 or 98942), but without a primary care office visit for neck pain in 2007.

Primary Care Cohort

Beneficiaries with at least one allowed Medicare B claim in 2007 for primary care office visit for evaluation and management, but without a chiropractic office visit for neck pain in 2007. (Primary care visits were identified as claims associated with the provider specialty code for Family Medicine (08), Internal Medicine (11) or General Practice (01). Evaluation and management services were identified by BETOS Code “M”.

Exposures

We included all beneficiaries covered under the Medicare B fee for service plan, aged 66–99 and living as of Jan 1st of each year, with at least one allowed Medicare B claim in 2007 for an office visit associated with a diagnosis of neck pain to either a chiropractor or primary care physician. Neck pain was identified by any of the following ICD-9 codes: 721.0, 721.1, 722.0, 722.4, 722.71, 722.81, 722.91, 723.0, 723.1, 723.2, 723.3, 723.5, 723.7, 723.8, 723.9, 739.1, 756.16, 756.2, 839.00, 839.01, 839.02, 839.03, 839.04, 839.05, 839.06, 839.07, 839.08, 847.0, 953.0, or 953.4. We excluded duplicate claims for the same patient, provider, procedure and date of service. We also excluded beneficiaries with a previous history of cerebrovascular disease (in Part A or Part B data) at any time during the one-year period prior to the date of first exposure and accrual to cohort. Prior cerebrovascular disease was identified by any of the following codes for stroke (ICD-9 430, 431, 432–432.9, 433–433.9, 434–434.9, 436, 437.1, 443.21, 443.24 or 900–900.9), transient cerebral ischemia (ICD-9 435 – 435.9) or late effects of cerebrovascular diseases (ICD-9 438 – 438.9). A one-year look back window from first exposure to office visit for neck pain and accrual to cohort served to exclude beneficiaries with a recent history of cerebrovascular disease and to calculate Charlson co-morbidity scores for risk adjustment. [Figure 1] The Charlson co-morbidity index is a validated prognostic tool based upon the risk of mortality associated with a range of comorbid chronic diseases. For each patient, individual conditions are assigned scores, which are summed to provide a total score.

An external file that holds a picture, illustration, etc.
Object name is nihms646741f1.jpg

Cohort Accrual

Medicare allows coverage for chiropractic spinal manipulation of up to five spinal regions (cervical, thoracic, lumbar, sacral and pelvic). It is not possible to specifically identify manipulation of the cervical spine through analysis of Medicare data, because the procedure codes for chiropractic spinal manipulation identify the number of spinal regions manipulated but not the specific spinal regions at which the manipulations were performed. However, Medicare does require that the level at which the manipulation is performed must be tied to the patient’s complaint.21 Therefore, assuming compliance with Medicare clinical practice guidelines, a patient complaint of neck pain should be associated with the delivery of cervical spine manipulation.

Outcomes Measurement

The hazard (observation) period for identifying outcomes was a 30 day window following each exposure to an office visit for neck pain. We set the hazard period at 30 days to allow for comparison of our results with the findings of previous reports.1 The primary outcome measure was VBS within 30 days of office visit for neck pain. However, due to the potential for bias resulting from the imprecise use of diagnosis codes in claims data, we also analyzed for any type of stroke. We identified stroke by ICD-9 code 430, 431, 432–432.9, 433–433.9, 434–434.9, 436, 437.1, 443.21, 443.24, or 900–900.9, recorded in hospital emergency department or in-patient claims. We categorized strokes as VBS and non-VBS - identifying VBS by diagnosis code 433.00, 433.01, 433.20 or 433.21 - all other stroke codes were categorized as non-VBS. As a secondary outcome measure, among those diagnosed with stroke we also evaluated for death within 30 days of office visit. For each successive office visit, we evaluated for days to diagnosis of stroke, and censored the previous visit. Subjects were removed from follow-up upon occurrence of their first stroke. Evaluation of risk by office visit allowed comparison of risk between cohorts while allowing for the high degree of variability in number, frequency and timing of office visits. For analysis of hazard of stroke within 30 days, we excluded subjects who were hospitalized for stroke on the same day as the office visit, because these patients likely presented with signs or symptoms of stroke. [Figure 2] The data used in this study were analyzed in accordance with a data user agreement with The Centers for Medicare and Medicaid Services. Rules for the conduct of Medicare approved research projects stipulate that specific quantities may not be disclosed if the unit of observation contains fewer than eleven subjects.

An external file that holds a picture, illustration, etc.
Object name is nihms646741f2.jpg

Exclusions and Censoring

Analysis

We initially measured incidence of first stroke following exposure to office visit, and analyzed for 30-day mortality following stroke. We compared the hazard of stroke within 30 days between patients visiting chiropractors and those visiting primary care physicians, using a Cox proportional hazards model. The model was adjusted for subject age, gender, race and Charlson comorbidity index. We used the same approach to estimate the hazard ratio of stroke within the first 7 days (by right censoring all subjects at 7 days). To estimate the cumulative probability of stroke up to 30 days for the chiropractic and PCP groups while adjusting for the covariates stated above, we used direct adjusted survival curves, as described by Zhang and colleagues.22,23 We performed data analyses in SAS (SAS Institute Inc., Cary, North Carolina).

RESULTS

We found 1,157,475 Medicare beneficiaries with an office visit to either a chiropractic or primary care physician for neck pain. [Figure 2] Of these, 38,138 (3%) had seen both types of providers: we excluded these subjects from the study population, thus creating two mutually exclusive cohorts of chiropractic and primary care patients. We excluded 55 (7.5 per 100,000) patients from the chiropractic cohort and 278 (72 per 100,000) patients from the primary care cohort who were diagnosed with stroke on the same day as an office visit for neck pain. The chiropractic cohort (n 733,321) was nearly twice as large as the primary care cohort (n 385,683), and the number of chiropractic office visits (7,041,912) was more than 11 times greater than the number of primary care office visits (608,374).

The two cohorts also differed with regard to age, gender, race, and co-morbidity score. [Table 1] The chiropractic cohort was younger, with a significantly greater proportion of subjects under the age of 75 and a lesser proportion over the age of 80. The chiropractic cohort also was comprised of a higher proportion of males and significantly lower proportions of blacks and other minorities. The chiropractic cohort appeared to be healthier than the primary care cohort, as indicated by a significant difference in Charlson comorbidity scores (0.92 vs. 1.29; difference −0.37, 95% CI −0.38, −0.36).

Table 1

Subject Characteristics

CohortChiropracticPrimary CareDifference (A-B)95% CI
Subjects733,321385683347,638
Office Visits for Neck Pain7,041,912608,3746,433,538
Subjects with Stroke3,7731,0692,704
Age in Years
% 66–6929.2724.255.02 4.84; 5.19
% 70–7429.1625.453.71 3.54; 3.88
% 75–7921.4621.99−0.53 −0.69; −0.37
% 80–8412.8316.22−3.39 −3.52; −3.25
% 85–997.2712.08−4.80 −4.92; −4.39
% Male38.7733.575.20 5.02; 5.39
Race
% White96.6286.989.63 9.54; 9.74
% Black1.416.98−5.56 −5.64; −5.47
% Other1.966.04−4.08 −4.15; −4.01
Mean Charlson Comorbidity Score0.921.29−0.37 −0.38; −0.36
CI = confidence interval;
p<0.05

The specific incidence of VBS was too small to report and thus precluded further analysis. The proportion of subjects with stroke of any type in the chiropractic cohort was 1.2 per 1,000 at 7 days following office visit for neck pain and 5.1 per 1,000 at 30 days. In the primary care cohort, the proportion of subjects with stroke of any type was 1.4 per 1,000 at 7 days following office visit for neck pain, and 2.8 per 1,000 at 30 days. [Figure 2] Among subjects who sustained any type of stroke, there was no significant difference in 30-day mortality between cohorts (chiropractic cohort 9.65%, primary care cohort 9.1%; difference 0.52%, 95% CI −1.88 −2.93.

From the day following office visit (Day 1) through Day 24, the probability of stroke was lower in the chiropractic cohort as compared to the primary care cohort (2 vs. 7 strokes per 100,000 subjects respectively at Day 1; 110 vs. 111 strokes per 100,000 subjects respectively at Day 24). However, on Days 25–30, the probability of stroke for the chiropractic cohort exceeded that for the primary care cohort (116 vs. 115 strokes per 100,000 subjects respectively at Day 25; 162 vs. 134 strokes per 100,000 subjects respectively at Day 30). Figure 3 illustrates the adjusted probability of stroke for the two cohorts over the 30 day hazard period. The unadjusted hazard ratio for the chiropractic cohort vs. the primary care cohort was 0.33 (95% CI 0.28–0.37) at 7 days, and 0.91 (95% CI 0.85–0.99) at 30 days. With adjustment for differences in patient characteristics however, hazard ratios at days 7 and 30 [Table 2] reflected the crossover effect illustrated in Figure 3. In the chiropractic cohort, risk of stroke was significantly lower at 7 days as compared to the primary care cohort (hazard ratio 0.39; 95% CI 0.33–0.45), but at 30 days, a slight but statistically significant elevation in risk was observed for the chiropractic cohort (hazard ratio 1.10; 95% CI 1.01–1.19). Male gender, increasing age category, and increased Charlson co-morbidity score were all associated with increased risk of stroke in the study population.

An external file that holds a picture, illustration, etc.
Object name is nihms646741f3.jpg

Adjusted Probability of Stroke over the First 30 Days Following Office Visit for Neck Pain

[Figure 3 subscript]: Day 1 = Day following the day of office visit

Table 2

Risk of Stroke Following Office Visit for Neck Pain

7 Days30 Days
Hazard
Ratio
95% CIHazard Ratio95% CI
Chiropractic (vs. Primary Care)0.39 0.330.451.10 1.011.19
Male Gender (vs. Female)1.44 1.271.621.37 1.291.45
Age Category (vs. 66–69)
70–741.29 1.041.601.16 1.041.29
75–791.90 1.542.341.93 1.742.14
80–843.03 2.463.7422.50 2.252.78
85+3.70 2.964.633.59 3.214.00
Race (vs. White)
African American1.210.851.711.20.991.46
Other1.110.791.571.030.851.25
Charlson Co-morbidity Score1.08 1.051.121.13 1.111.15
p<0.05

DISCUSSION

Because risk of stroke in general increases with age, understanding the relationship between cervical spine manipulation and stroke and in older adults will help assure the safe utilization of chiropractic care in this vulnerable population. This is the first study to focus upon the risk of stroke following spinal manipulation in older adults, so the results are not directly comparable to previous studies, but our results are consistent with reports by Rothwell et. al. and Cassidy et. al., which suggest that VBS is uncommon in older adults.2,24 Aging may be protective against VBS stroke, as compared to other types of stroke. With regard to risk of any type of stroke, we found that increasing age category was associated with increased risk of any type of stroke, consistent with morbidity data published by The National Institutes of Health.25

The specific incidence of VBS was too low to report, but the incidence was less than 9.8 per million Medicare part B beneficiaries aged 66–99 with office visit for neck pain. This result is remarkably consistent with the incidence rate of 9.7 cases of VBS per 1,000,000 population reported by Lee and colleagues.5 Because vertebral artery dissection and associated thromboembolism is the most plausible mechanism by which spinal manipulation could cause stroke, our findings support current best evidence suggesting that manipulation of the cervical spine is unlikely to be a significant cause of stroke in older adults.1,26,27

Blacks, Hispanics and Native Americans are known to be at higher risk of stroke than Asians and non-Hispanic whites,28 and the lack of effect of race in this study is most likely due to the fact that minorities were underrepresented in the study population, because minorities comprise only 3–4% of chiropractic users under Medicare.29 The increased risk associated with increased Charlson comorbidity score is likely due to the well-established increased risk of stroke associated with cardiovascular disease, diabetes, and previous history of cerebrovascular disease.28

We found that the probability of any type of stroke on the day of office visit (Day 0) was much lower in the chiropractic cohort as compared to the primary care cohort. With exclusion of strokes that occurred on the same day of office visit, the adjusted probability of stroke remained lower in the chiropractic cohort until Day 25, when relative risk was reversed and remained higher in the chiropractic cohort for the remainder of the hazard period. At Day 0, the higher probability of stroke in the primary care cohort may have been due to a propensity to seek medical rather than chiropractic care among patients with neck pain who also had other symptoms potentially related to stroke. The differences between cohorts in the timing of the diagnosis of stroke may also be related to differences in diagnostic practices between chiropractic and primary care physicians. Song and colleagues reported that significant differences in physician’s diagnostic practices may be unrelated to patient characteristics.30 The observed between-cohort differences in probability of stroke may be due to earlier and more aggressive diagnostic testing practices among primary care physicians as compared to chiropractic physicians. It is possible that the short-term increase in hazard of stroke in the primary care cohort was associated with increased treatment of neck pain with non-steroidal anti-inflammatory drugs (NSAIDS), which have been linked to increased risk of ischemic stroke.31 Although a purely speculative observation, investigation of this potential association may be indicated.

Regardless of the reason for the observed differences, with the exclusion of same-day strokes, the maximum observed effect size (observed at Day15) was an additional risk of 3 strokes per 10,000 office visits for the primary care cohort. Although statistically significant, this difference - as well as the crossover effect seen in Figure 3 - may not be clinically significant. The lack of a mechanism by which an office visit might cause a non-VBS stroke and the decreasing likelihood of a causal relationship over 30 days also cast doubt upon the clinical significance of these between-cohort differences in results.

The true probability of stroke is probably unaffected by an office visit to either type of provider, and likely resides between the two trend lines seen in Figure 3. Chiropractic physicians must be able to recognize symptoms of stroke to provide early detection, and when necessary refer patients for appropriate treatment.24 In a retrospective case series, six out of approximately 500 active chiropractic patients presented with symptoms and signs of stroke.32 Among respondents to a survey of 2,000 randomly selected US chiropractors, first recognition of undiagnosed life-threatening conditions, including stroke, reportedly occurred in the normal course of practice at a rate of one case every 2.5 years.33

Limitations

In designing this study we strove to reduce bias due to inaccurate diagnostic coding by including any type of stroke as an outcome of interest (despite the lack of evidence for a relationship between spinal manipulation and stroke other than VBS) but it is possible that our analysis may have been biased by an underrepresentation in claims data of the true incidence of VBS. However, patients presenting to a hospital with symptoms of stroke and a recent history of visiting a chiropractor may be subjected to a more aggressive workup for VBS, and consequent bias towards increased diagnosis of VBS.7 Therefore, because diagnostic misclassification in the chiropractic cohort is more likely to result in more claims for VBS rather than fewer, we are confident that our results do not significantly underestimate the risk of VBS stroke in this study population. The results for the chiropractic cohort reflect the risk of stroke following chiropractic spinal manipulation, not that following all clinical encounters with chiropractors, who routinely screen patients for contraindications to spinal manipulation and withhold manipulation from those perceived as being at risk.21 Finally, because not all Medicare beneficiaries are enrolled in Medicare Part B, the subjects did not represent a random sample of older US adults. However, the study population does represent the population of older US adults who are eligible to receive chiropractic services under Medicare Part B, and the very large sample size of more than 1 million subjects provided the analysis with high statistical power.

Conclusions

This is the first population based study in the US on risk of stroke following spinal manipulation, and the first such study to focus on older adults. Among Medicare B beneficiaries aged 66–99 with neck pain, the incidence of vertebrobasilar stroke was too low to allow further analysis. Chiropractic cervical spine manipulation is unlikely to cause stroke in patients aged 66–99 with neck pain. For patients who saw a chiropractic physician, the adjusted probability of any type of stroke was lower than those who saw a primary care physician at days 1 through 24 following office visit, but higher at days 25–30, but these temporal associations are of doubtful clinical significance.

Limitations

In designing this study we strove to reduce bias due to inaccurate diagnostic coding by including any type of stroke as an outcome of interest (despite the lack of evidence for a relationship between spinal manipulation and stroke other than VBS) but it is possible that our analysis may have been biased by an underrepresentation in claims data of the true incidence of VBS. However, patients presenting to a hospital with symptoms of stroke and a recent history of visiting a chiropractor may be subjected to a more aggressive workup for VBS, and consequent bias towards increased diagnosis of VBS.7 Therefore, because diagnostic misclassification in the chiropractic cohort is more likely to result in more claims for VBS rather than fewer, we are confident that our results do not significantly underestimate the risk of VBS stroke in this study population. The results for the chiropractic cohort reflect the risk of stroke following chiropractic spinal manipulation, not that following all clinical encounters with chiropractors, who routinely screen patients for contraindications to spinal manipulation and withhold manipulation from those perceived as being at risk.21 Finally, because not all Medicare beneficiaries are enrolled in Medicare Part B, the subjects did not represent a random sample of older US adults. However, the study population does represent the population of older US adults who are eligible to receive chiropractic services under Medicare Part B, and the very large sample size of more than 1 million subjects provided the analysis with high statistical power.

Conclusions

This is the first population based study in the US on risk of stroke following spinal manipulation, and the first such study to focus on older adults. Among Medicare B beneficiaries aged 66–99 with neck pain, the incidence of vertebrobasilar stroke was too low to allow further analysis. Chiropractic cervical spine manipulation is unlikely to cause stroke in patients aged 66–99 with neck pain. For patients who saw a chiropractic physician, the adjusted probability of any type of stroke was lower than those who saw a primary care physician at days 1 through 24 following office visit, but higher at days 25–30, but these temporal associations are of doubtful clinical significance.

Acknowledgments

FUNDING SOURCES

This study was supported by the National Institutes of Health under Award Number K01AT005092.

James M Whedon, Instructor, Dartmouth College, The Dartmouth Institute for Health Policy &amp; Clinical Practice, Dartmouth College;
Contributor Information.
CORRESPONDING AUTHOR, James M Whedon, DC, MS, gro.kcochctih@nodehw.m.semaj, PO Box 11 Grantham, NH 03753, 603 863 8749
Publisher's Disclaimer

Abstract

Objective

The purpose of this study was to quantify risk of stroke following chiropractic spinal manipulation, as compared to evaluation by a primary care physician, for Medicare beneficiaries aged 66–99 years with neck pain.

Methods

This is a retrospective cohort analysis of a 100% sample of annualized Medicare claims data on 1,157,475 beneficiaries aged 66–99 years with an office visit to either a chiropractor or primary care physician for neck pain. We compared hazard of vertebrobasilar stroke and any stroke at 7 and 30 days following office visit using a Cox proportional hazards model. We used direct adjusted survival curves to estimate cumulative probability of stroke up to 30 days for the two cohorts.

Results

The proportion of subjects with stroke of any type in the chiropractic cohort was 1.2 per 1,000 at 7 days, and 5.1 per 1,000 at 30 days. In the primary care cohort, the proportion of subjects with stroke of any type was 1.4 per 1,000 at 7 days, and 2.8 per 1,000 at 30 days. In the chiropractic cohort, the adjusted risk of stroke was significantly lower at 7 days as compared to the primary care cohort (hazard ratio 0.39; 95% CI 0.33–0.45), but at 30 days, a slight elevation in risk was observed for the chiropractic cohort (hazard ratio 1.10; 95% CI 1.01–1.19).

Conclusions

Among Medicare B beneficiaries aged 66–99 with neck pain, incidence of vertebrobasilar stroke was extremely low. Small differences in risk between patients who saw a chiropractor and those who saw a primary care physician are probably not clinically significant.

Keywords: Stroke, Spinal Manipulation, Adverse Effects, Neck Pain, Chiropractic, Vertebral Artery Dissection, Medicare
Abstract
Practical Applications

Footnotes

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

Contributorship

Concept development (provided idea for the research) JW

Design (planned the methods to generate the results) JW, TL

Supervision (provided oversight, responsible for organization and implementation, writing of the manuscript) JW, JL, RP, TL

Data collection/processing (responsible for experiments, patient management, organization, or reporting data) JW, YS

Analysis/interpretation (responsible for statistical analysis, evaluation, and presentation of the results) JW, YS, TM, RP

Literature search (performed the literature search) JW

Writing (responsible for writing a substantive part of the manuscript) JW, TM

Critical review (revised manuscript for intellectual content, this does not relate to spelling and grammar checking) JW, JL, YS, TM, TL, RP

.

CONFLICTS OF INTEREST

No conflicts of interest were reported for this study.

Footnotes

Contributor Information

James M Whedon, Instructor, Dartmouth College, The Dartmouth Institute for Health Policy &amp; Clinical Practice, Dartmouth College.

Yunjie Song, Research Associate, The Dartmouth Institute for Health Policy &amp; Clinical Practice, The Dartmouth Institute for Health Policy &amp; Clinical Practice, Dartmouth College.

Todd A Mackenzie, Associate Professor, Dartmouth College, The Dartmouth Institute for Health Policy and Clinical Practice, Dartmouth College.

Reed B Phillips, President Emeritus, Southern California University of Health Sciences, Southern California University of Health Sciences.

Timothy G Lukovits, Associate Professor of Neurology, Dartmouth College, Associate Professor of Neurology, Geisel School of Medicine, Dartmouth College.

Jon D Lurie, Associate Professor, Dartmouth College, The Dartmouth Institute for Health Policy and Clinical Practice, Dartmouth College.

Contributor Information

REFERENCES

REFERENCES

References

  • 1. Cassidy JD, Boyle E, Cote P, et al Risk of vertebrobasilar stroke and chiropractic care: results of a population-based case-control and case-crossover study. Spine (Phila Pa 1976) 2008 Feb 15;33(4 Suppl):S176–S183.[PubMed][Google Scholar]
  • 2. Rothwell DM, Bondy SJ, Williams JIChiropractic manipulation and stroke: a population-based case-control study. Stroke. 2001 May;32(5):1054–1060.[PubMed][Google Scholar]
  • 3. Smith WS, Johnston SC, Skalabrin EJ, et al Spinal manipulative therapy is an independent risk factor for vertebral artery dissection. Neurology. 2003 May 13;60(9):1424–1428.[PubMed][Google Scholar]
  • 4. Chestnut JLThe stroke issue: paucity of valid data, plethora of unsubstantiated conjecture. J Manipulative Physiol Ther. 2004 Jun;27(5):368–372.[PubMed][Google Scholar]
  • 5. Lee VH, Brown RD, Jr., Mandrekar JN, Mokri BIncidence and outcome of cervical artery dissection: a population-based study. Neurology. 2006 Nov 28;67(10):1809–1812.[PubMed][Google Scholar]
  • 6. Engelter ST, Grond-Ginsbach C, Metso TM, et al Cervical artery dissection: trauma and other potential mechanical trigger events. Neurology. 2013 May 21;80(21):1950–1957.[PubMed][Google Scholar]
  • 7. Boyle E, Cote P, Grier AR, Cassidy JDExamining vertebrobasilar artery stroke in two Canadian provinces. Spine (Phila Pa 1976) 2008 Feb 15;33(4 Suppl):S170–S175.[PubMed][Google Scholar]
  • 8. Rubinstein SM, Peerdeman SM, van Tulder MW, Riphagen I, Haldeman SA systematic review of the risk factors for cervical artery dissection. Stroke. 2005 Jul;36(7):1575–1580.[PubMed][Google Scholar]
  • 9. Ernst EAdverse effects of spinal manipulation: a systematic review. J R Soc Med. 2007 Jul;100(7):330–338.[Google Scholar]
  • 10. Tuchin PA replication of the study 'Adverse effects of spinal manipulation: a systematic review'. Chiropr Man Therap. 2012;20(1):30.[Google Scholar]
  • 11. Gouveia LO, Castanho P, Ferreira JJSafety of chiropractic interventions: a systematic review. Spine (Phila Pa 1976) 2009 May 15;34(11):E405–E413.[PubMed][Google Scholar]
  • 12. Carlesso LC, Gross AR, Santaguida PL, Burnie S, Voth S, Sadi JAdverse events associated with the use of cervical manipulation and mobilization for the treatment of neck pain in adults: a systematic review. Man Ther. 2010 Oct;15(5):434–444.[PubMed][Google Scholar]
  • 13. Haynes MJ, Vincent K, Fischhoff C, Bremner AP, Lanlo O, Hankey GJAssessing the risk of stroke from neck manipulation: a systematic review. Int J Clin Pract. 2012 Oct;66(10):940–947.[Google Scholar]
  • 14. Haneline MT, Rosner ALThe etiology of cervical artery dissection. J Chiropr Med. 2007 Sep;6(3):110–120.[Google Scholar]
  • 15. Paciaroni M, Bogousslavsky JCerebrovascular complications of neck manipulation. Eur Neurol. 2009;61(2):112–118.[PubMed][Google Scholar]
  • 16. Hollander M, Koudstaal PJ, Bots ML, Grobbee DE, Hofman A, Breteler MM. Incidence, risk, and case fatality of first ever stroke in the elderly population. The Rotterdam Study. J Neurol Neurosurg Psychiatry. 2003 Mar;74(3):317–321.
  • 17. Choi S, Boyle E, Cote P, Cassidy JDA population-based case-series of Ontario patients who develop a vertebrobasilar artery stroke after seeing a chiropractor. J Manipulative Physiol Ther. 2011 Jan;34(1):15–22.[PubMed][Google Scholar]
  • 18. Cassidy JD, Boyle E, Cote P, et al Risk of vertebrobasilar stroke and chiropractic care: results of a population-based case-control and case-crossover study. Spine. 2008 Feb 15;33(4 Suppl):S176–S183.[PubMed][Google Scholar]
  • 19. Hufnagel A, Hammers A, Schonle PW, Bohm KD, Leonhardt GStroke following chiropractic manipulation of the cervical spine. J Neurol. 1999 Aug;246(8):683–688.[PubMed][Google Scholar]
  • 20. Norris JW, Beletsky V, Nadareishvili ZG. Sudden neck movement and cervical artery dissection. The Canadian Stroke Consortium. Cmaj. 2000 Jul 11;163(1):38–40.
  • 21. Centers for Medicare and Medicaid Services. Chiropractic Billing Guide. Hingham, MA: NHIC Corp; 2013. Apr, [Accessed November 21, 2012]. . [PubMed]
  • 22. MacKenzie TA, Brown JR, Likosky DS, Wu Y, Grunkemeier GLReview of case-mix corrected survival curves. Ann Thorac Surg. 2012 May;93(5):1416–1425.[PubMed][Google Scholar]
  • 23. Zhang X, Loberiza FR, Klein JP, Zhang MJA SAS macro for estimation of direct adjusted survival curves based on a stratified Cox regression model. Comput Methods Programs Biomed. 2007 Nov;88(2):95–101.[PubMed][Google Scholar]
  • 24. Cassidy JD, Boyle E, Cote P, et al Risk of vertebrobasilar stroke and chiropractic care: results of a population-based case-control and case-crossover study. J Manipulative Physiol Ther. 2009 Feb;32(2 Suppl):S201–S208.[PubMed][Google Scholar]
  • 25. National Institutes of Health. National Heart L, and Blood Institute. Bethesda, MD: US Department of Health and Human Services; 2009. Morbidity and Mortality: 2009 Chartbook on Cardiovascular, Lung, and Blood Diseases. [PubMed]
  • 26. Murphy DRCurrent understanding of the relationship between cervical manipulation and stroke: what does it mean for the chiropractic profession? Chiropr Osteopat. 2010;18:22.[Google Scholar]
  • 27. Tuchin PChiropractic and stroke: association or causation? Int J Clin Pract. 2013 Sep;67(9):825–833.[PubMed][Google Scholar]
  • 28. Centers for Disease Control and Prevention [Accessed Nov 22, 2013];Stroke. .[PubMed]
  • 29. Whedon JM, Song YRacial disparities in the use of chiropractic care under Medicare. Alternative Therapies in Health and Medicine. 2012;18(6):20–26.[Google Scholar]
  • 30. Song Y, Skinner J, Bynum J, Sutherland J, Wennberg JE, Fisher ESRegional variations in diagnostic practices. New England Journal of Medicine. 2010 Jul 1;363(1):45–53.[Google Scholar]
  • 31. Varas-Lorenzo C, Riera-Guardia N, Calingaert B, et al Stroke risk and NSAIDs: a systematic review of observational studies. Pharmacoepidemiol Drug Saf. 2011 Dec;20(12):1225–1236.[PubMed][Google Scholar]
  • 32. Leach RAPatients with symptoms and signs of stroke presenting to a rural chiropractic practice. J Manipulative Physiol Ther. 2010 Jan;33(1):62–69.[PubMed][Google Scholar]
  • 33. Daniel DM, Ndetan H, Rupert RL, Martinez DSelf-reported recognition of undiagnosed life threatening conditions in chiropractic practice: a random survey. Chiropr Man Therap. 2012;20:21.[Google Scholar]
Collaboration tool especially designed for Life Science professionals.Drag-and-drop any entity to your messages.