Development and validation of a near-comprehensive RxNorm valueset of opioid medications
========================================================================================

* Michael Wasz
* Prabhu RV Shankar
* Elizabeth Sprouse
* Lyndsey Kirchner
* Matthew H. Garber
* James Jones
* Kenneth D. Mandl
* Andy McMurry

## ABSTRACT

**Objective** Develop a near-comprehensive opioid medications valueset for population measures of opioid related treatments and outcomes. The opioid valueset should be free, open source, and conform to the RxNorm standard federally mandated in every US-certified electronic health record.

**Materials and Methods** Cumulus opioid valueset was manually curated by the authors and expanded using computer assisted curation. Opioid classifier rules were developed to select opioid RxNorm concepts with known opioid receptor interactions, ingredients, keywords, and drug product formulations. Twelve publicly available valuesets were used to develop and validate the Cumulus opioid valueset. Validation accuracy was measured against a corpus of opioid medication orders and non-opioid pain relievers.

**Results** Cumulus opioid valueset recall was >99.9% when measured against opioid prescription RxNorm codes from UC Davis Health and Brigham and Women’s Hospital. Cumulus opioid valueset was 100% specific compared to three valuesets of non-opioid pain relievers.

**Discussion and Conclusion** To the authors’ knowledge, Cumulus opioid valueset is the largest publicly available valueset of opioid medications (8,926 RxNorm concepts). The intended use of this opioid valueset is for population health measures of opioid medications and related patient outcomes.

KEYWORDS
*   Analgesics
*   Opioid
*   RxNorm
*   Drug Classification
*   Electronic Health Records
*   Public Health Informatics

## INTRODUCTION

Opioid-based analgesia is the most commonly used treatment in postoperative pain management, with more than 95% of surgical patients receiving opioids during hospitalization[1,2]. This accounts to roughly 55 million patients in the United States each year. While many patients treated with opioids recover well, others experience opioid related adverse events[2] or develop opioid use disorder(OUD) [3,4]. To measure the frequency of opioid prescriptions[5,6] and opioid related outcomes[7], a comprehensive vocabulary[8] of opioid medication concepts are needed.

Electronic health records (EHR) contain longitudinal patient history[9–11], enabling measurements of patient status before, during, and after medication orders containing opioids, [12,13]. By analyzing the frequency of patient care trajectories involving opioid medications, it should be possible to decipher which care trajectories most commonly lead to better or worse outcomes. EHR data is a valuable resource to measure outcomes of opioid use disorder treatments such as naloxone and buprenorphine. At the time of this study, there are at least 30 opioid valuesets listed by the US national library of medicine (NLM)[8]. However, it remains unclear which combination of opioid valuesets should be selected to maximize sensitivity and specificity in opioid medication studies.

The primary objective of this study is to develop a near comprehensive list of opioid concepts referencing RxNorm[14]. RxNorm is the federally mandated standard drug vocabulary in the United States Core Data for Interoperability (USCDI)[11]. RxNorm contains precise drug type information, including brand names, generic names[15], medication strength, prescribable drug names[16], and relationships[17,18] to drugs across thirteen common medical vocabularies. The secondary objective of this study is to enable “push button population health” [9] measurement of opioid prescriptions and outcomes at national scale by adopting 21st Century Cures Act [19] mandated health data USCDI standards[11].

This study reports the Cumulus opioid valueset code[20] and data[21], freely available under the Apache-2.0 open source license. The Cumulus opioid valueset is published on VSAC[22].

## METHODS

The Cumulus opioid valueset was developed using published sources of opioids[23–30], expert manual curation, and computer assisted curation (**Figure 1**). Published valuesets were downloaded from the Value Set Authority Center (VSAC)[8]. Authors manually reviewed each opioid entry from an opioid medication valueset[29] using the Unified Medical Language System (UMLS) and Bioportal[31]. Each opioid concept was expanded to a larger valueset of opioid concepts having one or more opioid ingredients. Authors then manually curated a list of opioid ingredients, opioid keywords, and opioid classification rules for computer assisted curation. The medication reference terminology[32–34] (MED-RT) was used to automatically select all RxNorm concepts with known opioid receptor interactions[35,36]. Published opioid valuesets[23–30] were processed using opioid ingredients, opioid keywords, and opioid classification rules. The valueset aggregation of RxNorm concepts selected for opioid ingredients, opioid keywords, opioid receptor interactions, and opioid classifier rules were used to compile the Cumulus opioid valueset. Three VSAC non-opioid valuesets[37–39] were analyzed to provide examples of medications that do not include opioids. Non-opioid valuesets were used to test if non-opioid concepts were incorrectly included in the Cumulus opioid valueset. Lastly, sources of opioid prescriptions were analyzed to validate real world use of Cumulus opioid valueset in two medical centers.

![Figure 1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2024/11/05/2024.11.05.24316759/F1.medium.gif)

[Figure 1:](http://medrxiv.org/content/early/2024/11/05/2024.11.05.24316759/F1)

Figure 1: Methods to curate and validate the opioid Cumulus valueset.
Published sources were human expert curated and expanded using computer assisted curation. The Cumulus opioid valueset contains the aggregation from these curated sources. Validation is measured against opioid medication orders and non-opioid VSAC valuesets.

**Alt text:** Flowchart showing the process for curating and validating the Cumulus opioid valueset. Published sources, such as opioid receptor interactions and VSAC valuesets, undergo human expert curation and are expanded through computer-assisted curation using tools like MED-RT and BioPortal.

### Expert Manual Curation

The authors manually reviewed each opioid RxNorm concept from an opioid medications valueset[29] and verified each concept included an opioid ingredient in Bioportal. Each ingredient was then expanded using UMLS to include all RxNorm relationships[40] for all drug product formulations. In addition to ingredient-level curation, opioid keywords were curated to search for additional opioid medications. Common opioid-related terms, including both generic and brand names, were curated and refined iteratively to reduce false positives. The cumulus opioid keyword list was appended with a list of published VSAC valueset of opioid medication keywords[30].

### Computer Assisted Curation

Computer assisted curation was developed to expedite expert manual curation. Two computerized methods were developed: an opioid classifier and an MED-RT medication hierarchy of opioid receptor interactions. The opioid classifier rules were curated to select related opioid medications having similar opioid keywords, brand names, generic names, and multi-ingredient formulations by leveraging relationships such as “ingredient of” and “tradename of.” Additional rules were curated to disambiguate drug products with multiple ingredients such as cold medicines containing opioids. In total, the opioid classifier included keywords, ingredient-level relationships, and drug product formulations. The supplementary material contains the complete opioid classifier ruleset for each pair of RxNorm concepts, term types, and relationship attributes.

MED-RT was used to recursively include all RxNorm concepts in a hierarchy of opioid receptor interactions. MED-RT concepts were selected matching the keyword “opioid”. MED-RT provides a hierarchy of medication classes[32], namely mechanism of action (MoA), established pharmacologic class (EPC), and physiologic effects (PE). **Figure 2** illustrates the MED-RT partial hierarchy of Mu (μ) and Kappa (κ) opioid receptor interactions. Delta (δ) and nociceptin/orphanin FQ (NOP) receptors[41] are not included in the MED-RT hierarchy as there are currently no prescribable opioid medications for delta (δ) and NOP receptors.

![Figure 2:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2024/11/05/2024.11.05.24316759/F2.medium.gif)

[Figure 2:](http://medrxiv.org/content/early/2024/11/05/2024.11.05.24316759/F2)

Figure 2: Example RxNorm medications in the MED-RT hierarchy of opioid receptor interactions.
Opioid receptors hierarchically link RxNorm ingredients and RxNorm prescribable products. Shaded boxes denote MED-RT hierarchical concepts for the established pharmacologic class of opioid receptor interactions. Arrows denote direction of the hierarchical relationships. Unshaded boxes denote RxNorm medications. Bold denotes RxNorm ingredient concepts. Boxes on the bottom of the hierarchy provide examples of generic names, brand names, dose form, and strength. “Buprenorphine 8 MG / Naloxone 2 MG” illustrates how multiple ingredients can be combined in a single product.

**Alt text:** Hierarchical diagram illustrating the MED-RT hierarchy for opioid receptor interactions. The diagram branches into opioid agonists and antagonists, which further divide into full, partial, competitive, and non-competitive subtypes. Examples of RxNorm medications include Oxycodone (a full opioid agonist for the Mu receptor) and Narcan (a competitive opioid antagonist). Additional medications such as Buprenorphine 8 MG / Naloxone 2 MG are shown as products with combined ingredients.

### Accuracy Measurements

Sensitivity and specificity were measured for the Cumulus opioid valueset against nine VSAC opioid valuesets[22–29,41] and three VSAC non-opioid valuesets[37–39]. **Figure 3** illustrates accuracy measurements. Sensitivity (recall) was measured as the percentage of VSAC opioid concepts recalled using the Cumulus opioid valueset, using formula true positive (TP) divided by the sum of TP plus false negative (FN) [i.e. TP / (TP + FN)]. Specificity (true negative rate) was measured using formula true negative (TN) divided by the sum of TN plus false positive (FP) [i.e. TN / (TN+FP)]. True positives were defined as opioid concepts in a VSAC opioid valueset. True negatives were defined as opioid concepts in a VSAC non-opioid valueset. False positives were defined as opioid concepts present in both the Cumulus opioid valueset and an VSAC non-opioid valueset. False negatives were defined as opioid concepts present in a VSAC opioid valueset that were not present in the Cumulus opioid valueset. Truth conflicts exist when the same RxNorm concepts is present in both a VSAC opioid and VSAC non-opioid valueset. VSAC truth conflicts were resolved by authors (MGW, AJM, PRVS) to confirm ground truth labeling.

![Figure 3:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2024/11/05/2024.11.05.24316759/F3.medium.gif)

[Figure 3:](http://medrxiv.org/content/early/2024/11/05/2024.11.05.24316759/F3)

Figure 3: Accuracy of ground truth labels against the Cumulus and VSAC valuesets.
True positives denote RXCUIs present in both Cumulus opioids and VSAC opioids. False negatives denote RXCUIs present only in VSAC opioids valuesets. False positive RXCUIs denote Cumulus opioids also present in VSAC non-opioids. True negative denotes RXCUIs present only in VSAC non-opioids. Truth conflict denotes RXCUIs present in both VSAC opioids and non-opioids.

**Alt text:** Venn diagram illustrating the accuracy of Cumulus and VSAC valuesets. True positives are represented by the overlap between Cumulus opioids and VSAC opioids. False negatives refer to RXCUIs only present in VSAC opioids, while false positives denote RXCUIs present in Cumulus opioids but also found in VSAC non-opioids. True negatives represent RXCUIs only in VSAC non-opioids. A central section shows truth conflict, where RXCUIs exist in both VSAC opioids and non-opioids.

## RESULTS

Cumulus opioid valueset resulted in 8,926 unique opioid RxNorm concepts (**Figure 4**). To the authors’ knowledge, this is the largest publicly available opioid valueset conforming to standards federally mandated in every US-certified electronic health record system.

![Figure 4:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2024/11/05/2024.11.05.24316759/F4.medium.gif)

[Figure 4:](http://medrxiv.org/content/early/2024/11/05/2024.11.05.24316759/F4)

Figure 4: Cumulus opioid valueset curation and validation.
Published sources of opioid receptor interactions, opioid keywords, and opioid medications are curated. Human expert curation included UMLS/BioPortal and curation of common opioid keywords. Cumulus assisted curation of opioid receptor interactions and published VSAC opioid valuesets. Cumulus opioid valueset resulted in 8,926 unique RxNorm concepts. Validation was performed against hospital opioid medication orders and valuesets of non-opioid pain-relievers.

**Alt text:** Flowchart detailing the process of curating and validating the Cumulus opioid valueset. Human expert curation incorporates opioid receptor interactions, keywords, and concepts from UMLS/BioPortal. The process expands through computer-assisted curation, adding concepts from the MED-RT hierarchy and various VSAC valuesets. The final aggregation yields 8,926 unique RxNorm concepts, validated against opioid medication orders (99.9% sensitivity) and non-opioid valuesets (100% specificity).

Manual curation of 349 opioid medications[29] using UMLS/BioPortal yielded an expanded list of 2,007 RxNorm concepts. Opioid classifier rules were then used to select an additional set of 3,861 related concepts. MED-RT hierarchy included 1,834 concepts with a known opioid receptor interaction[35], which were then related to an additional 3,766 concepts using the opioid classifier rules. Opioid keywords were used to select 1,864 concepts from published VSAC opioid valuesets, which were then expanded to include 1,520 additional concepts. In total, 8,926 unique RxNorm concepts were selected using manual curation, opioid receptor interactions, opioid keywords, and opioid classifier rules of related RxNorm concepts.

### Validation

Cumulus opioid valueset was tested against multiple opioid and non-opioid valuesets, yielding >99.9% sensitivity and 100% specificity. Cumulus recalled 1,193 of 1,994 unique RxNorm concepts. Of these, Cumulus recalled all 228 concepts for opioid oral tablets and patches from Brigham and Women’s Hospital[42]. Cumulus recalled 1007 of 1137 concepts for opioids in the UC Davis Health set of opioid prescriptions. Upon manual review, only 1 of the 130 concepts missing opioid concepts was determined to be a prescribable opioid medication. The single truth conflict was due to the UC Davis Epic EHR medications grouper inadvertently including individual ingredients such as aspirin, ibuprofen, and guaifenesin that are commonly prescribed with codeine.

Cumulus opioid valueset specificity was 100% compared to three published VSAC valuesets for non-opioids[37–39]. None of the 3877 non-opioid RXCUIs were present in the Cumulus opioid valueset. Additional validation was performed against 2048 non-opioid concepts in a MED-RT hierarchy containing RxNorm concepts for classes: NSAID, barbiturate, and/or benzodiazepine. Confirmed by manual review, the Cumulus opioid valueset contained zero false positives from any non-opioid valueset[22].

VSAC validation rules were applied to the set of 8,926 RxNorm concepts resulting in 4,123 active concepts and 4,803 inactive concepts. Both active and inactive concepts are provided to readers to enable historical analysis of opioid prescriptions since the start of the opioid crisis.

## DISCUSSION

To the authors’ knowledge, this study presents the largest publicly available valueset of opioid medications using the RxNorm standard. The intended use of the Cumulus opioid valueset is to quickly measure opioid population health statistics across multiple healthcare organizations in parallel[9]. Cumulus is designed for use with US core standards for interoperability(USCDI) [43] with over 100 data elements[44] relevant to opioid studies, especially medications[45], conditions[46,47], vital signs[48], laboratory results[49], diagnostic reports[50], observations[51], clinical notes[52], and demographics[53] across a wide range of encounter settings[54]. When used with the USCDI data, Cumulus opioid valueset may be used to measure frequency of opioid prescriptions[55], trajectories of opioid use[56], treatment of opioid use disorders[57,58], and other opioid related population health statistics.

There were several limitations in this study. The Cumulus opioid valueset includes RxNorm opioid medication prescribed by a healthcare professional. Opioids acquired outside[59] of the healthcare system cannot be measured using prescriptions alone[60]. It was beyond the scope of this study to evaluate case definitions of substance use disorders using diagnosis concepts[61] and laboratory results[62]. Despite best efforts, it should be expected that not all cases of opioid use will be counted. The unregulated opioid supply frequently changes ingredient mixtures and chemical structures thus limiting detection using standardized toxicology screens. To estimate the true opioid use prevalence from the apparent opioid use prevalence[63], clinical notes[52] could be reviewed for a small sample of the population to adjust prevalence estimates.

## DECLARATION OF INTERESTS

Elizabeth Sprouse is the founder of Double Lantern Informatics, a for-profit consulting firm, and served as a consultant to the CDC Foundation during this project. The author has no significant conflicts of interest that would affect the integrity of the research. All other authors declare no conflicts of interest.

## DATA SHARING

Data and code are freely available under the Apache-2.0 license. Code for building the Cumulus opioid valueset is available at [https://github.com/smart-on-fhir/cumulus-library-opioid-valueset](https://github.com/smart-on-fhir/cumulus-library-opioid-valueset). Supplementary data is available at [https://github.com/smart-on-fhir/cumulus-library-opioid-valueset-supplement](https://github.com/smart-on-fhir/cumulus-library-opioid-valueset-supplement).

## Supporting information

Supplemental File 1 [[supplements/316759_file06.docx]](pending:yes)

Supplemental File 2 [[supplements/316759_file07.docx]](pending:yes)

## Data Availability

Data and code are freely available under the Apache-2.0 license. Code for building the Cumulus opioid valueset is available at [https://github.com/smart-on-fhir/cumulus-library-opioid-valueset](https://github.com/smart-on-fhir/cumulus-library-opioid-valueset). Supplementary data is available at [https://github.com/smart-on-fhir/cumulus-library-opioid-valueset-supplement](https://github.com/smart-on-fhir/cumulus-library-opioid-valueset-supplement)

[https://github.com/smart-on-fhir/cumulus-library-opioid-valueset](https://github.com/smart-on-fhir/cumulus-library-opioid-valueset)

[https://github.com/smart-on-fhir/cumulus-library-opioid-valueset-supplement](https://github.com/smart-on-fhir/cumulus-library-opioid-valueset-supplement)

## FUNDING

This work was supported by the Office of the National Coordinator for Health Information Technology contract numbers 90AX0031/01-00, 90AX0022/01-00, and 90AX0040/01-00; Centers for Disease Control and Prevention of the United States Department of Health and Human Services (HHS) as part of a financial assistance award, Strengthened Community Partnerships for More Holistic Approaches to Interoperability totaling $1,985,178 (The contents are those of the author(s) and do not necessarily represent the official views of, nor an endorsement, by the CDC Foundation, CDC/HHS, or the U.S. Government); The National Center for Advancing Translational Sciences/National Institutes of Health Cooperative Agreements U01TR002623 and U01TR002997; National Association of Chronic Disease Directors/Centers for Disease Control and Prevention Grant No. NU38OT000286; Centers for Disease Control and Prevention Grant No. U18DP006500; and Centers for Disease Control and Prevention Cooperative Agreement Nos. NU58IP000004 and 1U01TR002997-01A1.

## ACKNOWLEDGMENTS

Authors thank the UC Davis pharmacy and informatics teams with special thanks to Eugene Kang and Momeema Ali.

*   Received November 5, 2024.
*   Revision received November 5, 2024.
*   Accepted November 5, 2024.


*   © 2024, Posted by Cold Spring Harbor Laboratory

This pre-print is available under a Creative Commons License (Attribution-NoDerivs 4.0 International), CC BY-ND 4.0, as described at [http://creativecommons.org/licenses/by-nd/4.0/](http://creativecommons.org/licenses/by-nd/4.0/)

## REFERENCES

1.  Baker J, Brovman EY, Rao N, et al. Potential Opioid-Related Adverse Drug Events Are Associated With Decreased Revenue in Hip Replacement Surgery in the Older Population. Geriatr Orthop Surg Rehabil. 2020;11:2151459320915328. doi: 10.1177/2151459320915328
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/2151459320915328&link_type=DOI) 

2.  Hospital harm - opioid-related adverse events. [https://ecqi.healthit.gov/ecqm/eh/2024/cms0819v2](https://ecqi.healthit.gov/ecqm/eh/2024/cms0819v2) (accessed 5 May 2024)
    
    

3.  Dasgupta N, Beletsky L, Ciccarone D. Opioid Crisis: No Easy Fix to Its Social and Economic Determinants. Am J Public Health. 2018;108:182–6. doi: 10.2105/AJPH.2017.304187
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.2105/AJPH.2017.304187&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=29267060&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F11%2F05%2F2024.11.05.24316759.atom) 

4.  2019 NSDUH annual national report. [https://www.samhsa.gov/data/report/2019-nsduh-annual-national-report](https://www.samhsa.gov/data/report/2019-nsduh-annual-national-report) (accessed 5 May 2024)
    
    

5.  Seth P, Rudd RA, Noonan RK, et al. Quantifying the Epidemic of Prescription Opioid Overdose Deaths. Am J Public Health. 2018;108:500–2. doi: 10.2105/AJPH.2017.304265
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.2105/AJPH.2017.304265&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=29513577&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F11%2F05%2F2024.11.05.24316759.atom) 

6.  Fraser M, Plescia M. The Opioid Epidemic’s Prevention Problem. Am J Public Health. 2019;109:215–7. doi: 10.2105/AJPH.2018.304859
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.2105/AJPH.2018.304859&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=30649947&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F11%2F05%2F2024.11.05.24316759.atom) 

7.  Ordean A, Tubman-Broeren M. Safety and Efficacy of Buprenorphine-Naloxone in Pregnancy: A Systematic Review of the Literature. Pathophysiology. 2023;30:27–36. doi: 10.3390/pathophysiology30010004
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.3390/pathophysiology30010004&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=36810423&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F11%2F05%2F2024.11.05.24316759.atom) 

8.  Bodenreider O, Nguyen D, Chiang P, et al. The NLM value set authority center. Stud Health Technol Inform. 2013;192:1224.
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23920998&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F11%2F05%2F2024.11.05.24316759.atom) 

9.  Mandl KD, Gottlieb D, Mandel JC, et al. Push Button Population Health: The SMART/HL7 FHIR Bulk Data Access Application Programming Interface. NPJ Digit Med. 2020;3:151. doi: 10.1038/s41746-020-00358-4
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41746-020-00358-4&link_type=DOI) 

10. McMurry AJ, Gottlieb DI, Miller TA, et al. Cumulus: a federated electronic health record-based learning system powered by Fast Healthcare Interoperability Resources and artificial intelligence. J Am Med Inform Assoc. 2024;31:1638–47. doi: 10.1093/jamia/ocae130
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/jamia/ocae130&link_type=DOI) 

11. United States core data for interoperability (USCDI). [https://www.healthit.gov/isa/united-states-core-data-interoperability-uscdi](https://www.healthit.gov/isa/united-states-core-data-interoperability-uscdi) (accessed 25 October 2023)
    
    

12. Palumbo SA, Adamson KM, Krishnamurthy S, et al. Assessment of Probable Opioid Use Disorder Using Electronic Health Record Documentation. JAMA Netw Open. 2020;3:e2015909. doi: 10.1001/jamanetworkopen.2020.15909
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/jamanetworkopen.2020.15909&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32886123&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F11%2F05%2F2024.11.05.24316759.atom) 

13. Poulsen MN, Nordberg CM, Troiani V, et al. Identification of opioid use disorder using electronic health records: Beyond diagnostic codes. Drug Alcohol Depend. 2023;251:110950. doi: 10.1016/j.drugalcdep.2023.110950
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.drugalcdep.2023.110950&link_type=DOI) 

14. Parrish F, Do N, Bouhaddou O, et al. Implementation of RxNorm as a terminology mediation standard for exchanging pharmacy medication between federal agencies. AMIA Annu Symp Proc. 2006;1057.
    
    

15. Nelson SJ, Zeng K, Kilbourne J, et al. Normalized names for clinical drugs: RxNorm at 6 years. J Am Med Inform Assoc. 2011;18:441–8. doi: 10.1136/amiajnl-2011-000116
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1136/amiajnl-2011-000116&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=21515544&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F11%2F05%2F2024.11.05.24316759.atom) 

16. Le H, Chen R, Harris S, et al. RxNorm for drug name normalization: a case study of prescription opioids in the FDA adverse events reporting system. Front Bioinform. 2023;3:1328613. doi: 10.3389/fbinf.2023.1328613
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.3389/fbinf.2023.1328613&link_type=DOI) 

17. Bodenreider O. The Unified Medical Language System (UMLS): integrating biomedical terminology. Nucleic Acids Res. 2004;32:D267–70. doi: 10.1093/nar/gkh061
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/nar/gkh061&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=14681409&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F11%2F05%2F2024.11.05.24316759.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000188079000061&link_type=ISI) 

18. Metathesaurus. National Library of Medicine (US) 2021.
    
    

19. Office of the National Coordinator of Health Information Technology. 21st Century Cures Act Final Rule. 2020. [https://www.healthit.gov/curesrule/resources/information-blocking-faqs](https://www.healthit.gov/curesrule/resources/information-blocking-faqs) (accessed 12 February 2023)
    
    

20. Cumulus Opioid Valueset (Code). GitHub Code. [https://github.com/smart-on-fhir/cumulus-library-opioid-valueset](https://github.com/smart-on-fhir/cumulus-library-opioid-valueset) (accessed 10 October 2024)
    
    

21. Cumulus Opioid Valueset (data supplement). [https://github.com/smart-on-fhir/cumulus-library-opioid-valueset-supplement](https://github.com/smart-on-fhir/cumulus-library-opioid-valueset-supplement) (accessed 11 October 2024)
    
    

22. Cumulus Author. Opioids [value set]. VSAC; Published by Cumulus Steward. Updated February 2024. Accessed October 28, 2024. [https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1284.1/definition](https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1284.1/definition)
    
    

23. CancerLinQ. Opioids. Value Set Authority Center. 2024. [https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1116.449/expansion](https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1116.449/expansion) (accessed 31 July 2024)
    
    

24. IMPAQ International. All Opioids. Value Set Authority Center. 2019. [https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1196.87/expansion](https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1196.87/expansion) (accessed 31 July 2024)
    
    

25. American College of Emergency Physicians/AMA-PCPI. Opioid Meds. Value Set Authority Center. 2020. [https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1106.68/expansion](https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1106.68/expansion) (accessed 31 July 2024)
    
    

26. Agency for Healthcare Research and Quality Clinical Decision Support Connect Project. Opioid pain medications. Value Set Authority Center. 2023. [https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1032.34/expansion](https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1032.34/expansion) (accessed 31 July 2024)
    
    

27. ECRI. All prescribable opioids used for pain control including Inactive Medications. Value Set Authority Center. 2015. [https://vsac.nlm.nih.gov/valueset/1.3.6.1.4.1.6997.4.1.2.234.999.3.2/expansion](https://vsac.nlm.nih.gov/valueset/1.3.6.1.4.1.6997.4.1.2.234.999.3.2/expansion) (accessed 31 July 2024)
    
    

28. Lantana. Schedule II, III and IV Opioid Medications. Value Set Authority Center. 2024. [https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1046.241/expansion](https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1046.241/expansion) (accessed 31 July 2024)
    
    

29. Mathematica. Opioid Medications. Value Set Authority Center. 2020. [https://vsac.nlm.nih.gov/valueset/2.16.840.1.113883.3.3157.1004.26/expansion](https://vsac.nlm.nih.gov/valueset/2.16.840.1.113883.3.3157.1004.26/expansion) (accessed 31 July 2024)
    
    

30. Cliniwiz. Opioid medication key words. Value Set Authority Center. [https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1200.163/expansion/](https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1200.163/expansion/) (accessed 11 October 2024)
    
    

31. Noy NF, Shah NH, Whetzel PL, et al. BioPortal: ontologies and integrated data resources at the click of a mouse. Nucleic Acids Res. 2009;37:W170–3. doi: 10.1093/nar/gkp440
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/nar/gkp440&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=19483092&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F11%2F05%2F2024.11.05.24316759.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000267889100031&link_type=ISI) 

32. National Library of Medicine. MED-RT (Medication Reference Terminology). 2018. [https://www.nlm.nih.gov/research/umls/sourcereleasedocs/current/MED-RT/index.html](https://www.nlm.nih.gov/research/umls/sourcereleasedocs/current/MED-RT/index.html) (accessed 6 May 2024)
    
    

33. Palchuk MB, Klumpenaar M, Jatkar T, et al. Enabling Hierarchical View of RxNorm with NDF-RT Drug Classes. AMIA Annu Symp Proc. 2010;2010:577–81.
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=21347044&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F11%2F05%2F2024.11.05.24316759.atom) 

34. Pathak J, Murphy SP, Willaert BN, et al. Using RxNorm and NDF-RT to classify medication data extracted from electronic health records: experiences from the Rochester Epidemiology Project. AMIA Annu Symp Proc. 2011;2011:1089–98.
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22195170&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F11%2F05%2F2024.11.05.24316759.atom) 

35. National Drug File - Reference Terminology - Opioid Receptor Interactions [MoA] - Classes. [http://purl.bioontology.org/ontology/NDFRT/N0000000200](http://purl.bioontology.org/ontology/NDFRT/N0000000200) (accessed 14 August 2024)
    
    

36. Dhaliwal A, Gupta M. Physiology, Opioid Receptor. StatPearls Publishing 2023.
    
    

37. CancerLinQ. Non Opioid Analgesics. Value Set Authority Center. 2024. [https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1260.173/expansion](https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1260.173/expansion)
    
    

38. MD Partners. Non opioid pain medications. Value Set Authority Center. 2020. [https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1021.73/expansion](https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1021.73/expansion) (accessed 16 October 2024)
    
    

39. MITRE. Non Opioid from ATC. Value Set Authority Center. 2023. [https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1032.291/expansion](https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1032.291/expansion) (accessed 16 October 2024)
    
    

40. Appendix 1 - RxNorm Relationships (RELA). Published Online First: 1 September 2023.
    
    

41. Toll L, Bruchas MR, Calo’ G, et al. Nociceptin/orphanin FQ receptor structure, signaling, ligands, functions, and interactions with opioid systems. Pharmacol Rev. 2016;68:419–57. doi: 10.1124/pr.114.009209
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoicGhhcm1yZXYiO3M6NToicmVzaWQiO3M6ODoiNjgvMi80MTkiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyNC8xMS8wNS8yMDI0LjExLjA1LjI0MzE2NzU5LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

42. Brigham and Women’s Hospital. Opioid (Oral Tablets and Patches only). Value Set Authority Center. 2019. [https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1206.12/expansion](https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1206.12/expansion) (accessed 16 October 2024)
    
    

43. Gov H. USCDI Patient demographics/information. United States Core Data for Interoperability (USCDI). [https://www.healthit.gov/isa/uscdi-data-class/patient-demographicsinformation](https://www.healthit.gov/isa/uscdi-data-class/patient-demographicsinformation) (accessed 29 March 2023)
    
    

44. HL7.FHIR.US.CORE\Profiles and Extensions - FHIR v4.0.1. [https://hl7.org/fhir/us/core/STU4/profiles-and-extensions.html](https://hl7.org/fhir/us/core/STU4/profiles-and-extensions.html) (accessed 10 October 2024)
    
    

45. HL7.FHIR.US.CORE\US Core MedicationRequest Profile - FHIR v4.0.1. [https://hl7.org/fhir/us/core/StructureDefinition-us-core-medicationrequest.html](https://hl7.org/fhir/us/core/StructureDefinition-us-core-medicationrequest.html) (accessed 10 October 2024)
    
    

46. US core condition encounter diagnosis profile - US core implementation guide v7.0.0. [https://hl7.org/fhir/us/core/StructureDefinition-us-core-condition-encounter-diagnosis.html](https://hl7.org/fhir/us/core/StructureDefinition-us-core-condition-encounter-diagnosis.html) (accessed 10 October 2024)
    
    

47. US Core Condition Problems and Health Concerns Profile - US Core Implementation Guide v7.0.0. [https://hl7.org/fhir/us/core/StructureDefinition-us-core-condition-problems-health-concerns.html](https://hl7.org/fhir/us/core/StructureDefinition-us-core-condition-problems-health-concerns.html) (accessed 10 October 2024)
    
    

48. US Core Vital Signs Profile - US Core Implementation Guide v7.0.0. [https://hl7.org/fhir/us/core/StructureDefinition-us-core-vital-signs.html](https://hl7.org/fhir/us/core/StructureDefinition-us-core-vital-signs.html) (accessed 10 October 2024)
    
    

49. US Core Laboratory Result Observation Profile - US Core Implementation Guide v7.0.0. [https://hl7.org/fhir/us/core/StructureDefinition-us-core-observation-lab.html](https://hl7.org/fhir/us/core/StructureDefinition-us-core-observation-lab.html) (accessed 10 October 2024)
    
    

50. US Core DiagnosticReport Profile for Laboratory Results Reporting - US Core Implementation Guide v7.0.0. [https://hl7.org/fhir/us/core/StructureDefinition-us-core-diagnosticreport-lab.html](https://hl7.org/fhir/us/core/StructureDefinition-us-core-diagnosticreport-lab.html) (accessed 10 October 2024)
    
    

51. US Core Observation Clinical Result Profile - US Core Implementation Guide v7.0.0. [https://hl7.org/fhir/us/core/StructureDefinition-us-core-observation-clinical-result.html](https://hl7.org/fhir/us/core/StructureDefinition-us-core-observation-clinical-result.html) (accessed 10 October 2024)
    
    

52. Clinical Notes - US Core Implementation Guide v7.0.0. [https://hl7.org/fhir/us/core/clinical-notes.html](https://hl7.org/fhir/us/core/clinical-notes.html) (accessed 10 October 2024)
    
    

53. US Core Patient Profile - US Core Implementation Guide v7.0.0. [https://hl7.org/fhir/us/core/StructureDefinition-us-core-patient.html](https://hl7.org/fhir/us/core/StructureDefinition-us-core-patient.html) (accessed 10 October 2024)
    
    

54. US Core Encounter Profile - US Core Implementation Guide v7.0.0. [https://hl7.org/fhir/us/core/StructureDefinition-us-core-encounter.html](https://hl7.org/fhir/us/core/StructureDefinition-us-core-encounter.html) (accessed 10 October 2024)
    
    

55. Straub L, Huybrechts KF, Hernandez-Diaz S, et al. Chronic prescription opioid use in pregnancy in the United States. Pharmacoepidemiol Drug Saf. 2021;30:504–13. doi: 10.1002/pds.5194
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/pds.5194&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=33428239&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F11%2F05%2F2024.11.05.24316759.atom) 

56. Straub L, Huybrechts KF, Hernández-Díaz S, et al. Trajectories of Prescription Opioid Utilization During Pregnancy Among Prepregnancy Chronic Users and Risk of Neonatal Opioid Withdrawal Syndrome. Am J Epidemiol. 2022;191:208–19. doi: 10.1093/aje/kwab249
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/aje/kwab249&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=34643225&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F11%2F05%2F2024.11.05.24316759.atom) 

57. Straub L, Bateman BT, Hernández-Díaz S, et al. Comparative safety of in utero exposure to buprenorphine combined with naloxone vs buprenorphine alone. JAMA. 2024;332:805–16. doi: 10.1001/jama.2024.11501
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/jama.2024.11501&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=39133511&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F11%2F05%2F2024.11.05.24316759.atom) 

58. Suarez EA, Huybrechts KF, Straub L, et al. Buprenorphine versus Methadone for Opioid Use Disorder in Pregnancy. N Engl J Med. 2022;387:2033–44. doi: 10.1056/NEJMoa2203318
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa2203318&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=36449419&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F11%2F05%2F2024.11.05.24316759.atom) 

59. Spencer M, Garnett M, Miniño A. Drug overdose deaths in the United States, 2002-2022. National Center for Health Statistics (U.S.) 2023.
    
    

60. CDC. Understanding the Opioid Overdose Epidemic. Overdose Prevention. 2024. [https://www.cdc.gov/overdose-prevention/about/understanding-the-opioid-overdose-epidemic.html](https://www.cdc.gov/overdose-prevention/about/understanding-the-opioid-overdose-epidemic.html) (accessed 10 October 2024)
    
    

61. HL7 Patient Care Work Group. Drug Misuse. Value Set Authority Center. 2023. [https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1222.707/expansion](https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1222.707/expansion) (accessed 10 October 2024)
    
    

62. Council of State and Territorial Epidemiologists (CSTE). Opioids, Benzodiazepines, or Barbiturates (Tests by Any Method). Value Set Authority Center. 2024. [https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1146.2293/expansion](https://vsac.nlm.nih.gov/valueset/2.16.840.1.113762.1.4.1146.2293/expansion) (accessed 10 October 2024)
    
    

63. Habibzadeh F, Habibzadeh P, Yadollahie M. The apparent prevalence, the true prevalence. Biochem Med . 2022;32:020101. doi: 10.11613/BM.2022.020101
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.11613/BM.2022.020101&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=35799992&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F11%2F05%2F2024.11.05.24316759.atom)