Categories
Nevin Manimala Statistics

Does the SORG Machine-learning Algorithm for Extremity Metastases Generalize to a Contemporary Cohort of Patients? Temporal Validation From 2016 to 2020

Clin Orthop Relat Res. 2023 May 25. doi: 10.1097/CORR.0000000000002698. Online ahead of print.

ABSTRACT

BACKGROUND: The ability to predict survival accurately in patients with osseous metastatic disease of the extremities is vital for patient counseling and guiding surgical intervention. We, the Skeletal Oncology Research Group (SORG), previously developed a machine-learning algorithm (MLA) based on data from 1999 to 2016 to predict 90-day and 1-year survival of surgically treated patients with extremity bone metastasis. As treatment regimens for oncology patients continue to evolve, this SORG MLA-driven probability calculator requires temporal reassessment of its accuracy.

QUESTION/PURPOSE: Does the SORG-MLA accurately predict 90-day and 1-year survival in patients who receive surgical treatment for a metastatic long-bone lesion in a more recent cohort of patients treated between 2016 and 2020?

METHODS: Between 2017 and 2021, we identified 674 patients 18 years and older through the ICD codes for secondary malignant neoplasm of bone and bone marrow and CPT codes for completed pathologic fractures or prophylactic treatment of an impending fracture. We excluded 40% (268 of 674) of patients, including 18% (118) who did not receive surgery; 11% (72) who had metastases in places other than the long bones of the extremities; 3% (23) who received treatment other than intramedullary nailing, endoprosthetic reconstruction, or dynamic hip screw; 3% (23) who underwent revision surgery, 3% (17) in whom there was no tumor, and 2% (15) who were lost to follow-up within 1 year. Temporal validation was performed using data on 406 patients treated surgically for bony metastatic disease of the extremities from 2016 to 2020 at the same two institutions where the MLA was developed. Variables used to predict survival in the SORG algorithm included perioperative laboratory values, tumor characteristics, and general demographics. To assess the models’ discrimination, we computed the c-statistic, commonly referred to as the area under the receiver operating characteristic (AUC) curve for binary classification. This value ranged from 0.5 (representing chance-level performance) to 1.0 (indicating excellent discrimination) Generally, an AUC of 0.75 is considered high enough for use in clinical practice. To evaluate the agreement between predicted and observed outcomes, a calibration plot was used, and the calibration slope and intercept were calculated. Perfect calibration would result in a slope of 1 and intercept of 0. For overall performance, the Brier score and null-model Brier score were determined. The Brier score can range from 0 (representing perfect prediction) to 1 (indicating the poorest prediction). Proper interpretation of the Brier score necessitates a comparison with the null-model Brier score, which represents the score for an algorithm that predicts a probability equal to the population prevalence of the outcome for each patient. Finally, a decision curve analysis was conducted to compare the potential net benefit of the algorithm with other decision-support methods, such as treating all or none of the patients. Overall, 90-day and 1-year mortality were lower in the temporal validation cohort than in the development cohort (90 day: 23% versus 28%; p < 0.001, and 1 year: 51% versus 59%; p<0.001).

RESULTS: Overall survival of the patients in the validation cohort improved from 28% mortality at the 90-day timepoint in the cohort on which the model was trained to 23%, and 59% mortality at the 1-year timepoint to 51%. The AUC was 0.78 (95% CI 0.72 to 0.82) for 90-day survival and 0.75 (95% CI 0.70 to 0.79) for 1-year survival, indicating the model could distinguish the two outcomes reasonably. For the 90-day model, the calibration slope was 0.71 (95% CI 0.53 to 0.89), and the intercept was -0.66 (95% CI -0.94 to -0.39), suggesting the predicted risks were overly extreme, and that in general, the risk of the observed outcome was overestimated. For the 1-year model, the calibration slope was 0.73 (95% CI 0.56 to 0.91) and the intercept was -0.67 (95% CI -0.90 to -0.43). With respect to overall performance, the model’s Brier scores for the 90-day and 1-year models were 0.16 and 0.22. These scores were higher than the Brier scores of internal validation of the development study (0.13 and 0.14) models, indicating the models’ performance has declined over time.

CONCLUSION: The SORG MLA to predict survival after surgical treatment of extremity metastatic disease showed decreased performance on temporal validation. Moreover, in patients undergoing innovative immunotherapy, the possibility of mortality risk was overestimated in varying severity. Clinicians should be aware of this overestimation and discount the prediction of the SORG MLA according to their own experience with this patient population. Generally, these results show that temporal reassessment of these MLA-driven probability calculators is of paramount importance because the predictive performance may decline over time as treatment regimens evolve. The SORG-MLA is available as a freely accessible internet application at https://sorg-apps.shinyapps.io/extremitymetssurvival/.Level of Evidence Level III, prognostic study.

PMID:37229565 | DOI:10.1097/CORR.0000000000002698

Categories
Nevin Manimala Statistics

Student Use and Perceptions of Embedded Formative Assessments in a Basic Science Veterinary Program

J Vet Med Educ. 2023 May 25:e20230011. doi: 10.3138/jvme-2023-0011. Online ahead of print.

ABSTRACT

This work describes the implementation of online timed closed-book formative assessments across several modules of a first-year undergraduate veterinary program. This process does not require significant time investment since it can be implemented into existing programs of study. Students were surveyed on how they used these formative assessments for learning and overall, were overwhelmingly positive about the opportunity to practice and receive feedback on their performance. Quantitative statistics on preferences as well as qualitative thematic analysis of open free-text questions reveal clear preferences in how they choose to engage with the assessments for learning, as well as how they prefer assessments to be administered. Students were positive about the online nature of the exams and prefer formative assessments to be distributed across the teaching semesters without any time restrictions, allowing them to be completed as and when they choose. Immediate feedback in the form of model answers is the students’ preference, although some value signposting to relevant resources for further research. Furthermore, students report that they want more questions and tests to complement their learning, and overwhelming rely on guided and structured activities for learning and revision which will need to be balanced with opportunities to develop critical thinking and independent learning skills when studying in a professional course, given students are not likely to default into such behavior. This work models a process many curriculum designers have, and continue to undergo in higher education as online, hybrid, and blended approaches to teaching have received renewed interest.

PMID:37229550 | DOI:10.3138/jvme-2023-0011

Categories
Nevin Manimala Statistics

Growth Mindset in Veterinary Educators: An International Survey

J Vet Med Educ. 2023 May 25:e20220128. doi: 10.3138/jvme-2022-0128. Online ahead of print.

ABSTRACT

Carol Dweck’s mindset theory describes whether an individual believes that attributes, like intelligence or morality, can be honed (growth mindset) or are innate (fixed mindset). An educator’s mindset impacts their approach to teaching, students’ learning, participation in faculty development, and wellbeing. Mindset can affect faculty members’ openness to curricular change, making the study of veterinary educator mindset timely and salient, as competency-based education is spurring curricular change worldwide. The purpose of this study was to examine the mindsets of veterinary educators internationally. A survey, consisting of demographic questions and mindset items (based on previously published scales), was distributed electronically to veterinary educators internationally, at universities where English is the primary instruction medium. Mindset was evaluated for the following traits: intelligence, clinical reasoning, compassion, and morality. Scale validation, descriptive statistics, and associations to demographic variables were evaluated. Four hundred and forty-six complete surveys were received. Overall, the study population demonstrated predominantly growth mindsets for all traits, higher than population averages, with some variation by trait. There was a small effect on years teaching towards growth mindset. No other associations were found. Veterinary educators internationally who participated in this study demonstrated higher rates of growth mindset than the general population. In other fields, a growth mindset in educators has had implications for faculty wellbeing, teaching and assessment practices, participation in faculty development, and openness to curricular change. Further research is needed in veterinary education to evaluate the implications of these high rates of growth mindset.

PMID:37229549 | DOI:10.3138/jvme-2022-0128

Categories
Nevin Manimala Statistics

A Cautionary Note on “A Cautionary Note on the Use of Ornstein Uhlenbeck Models in Macroevolutionary Studies”

Syst Biol. 2023 May 25:syad012. doi: 10.1093/sysbio/syad012. Online ahead of print.

ABSTRACT

Models based on the Ornstein-Uhlenbeck process have become standard for the comparative study of adaptation. Cooper et al. (2016) have cast doubt on this practice by claiming statistical problems with fitting Ornstein-Uhlenbeck models to comparative data. Specifically, they claim that statistical tests of Brownian motion may have too high Type I error rates and that such error rates are exacerbated by measurement error. In this note, we argue that these results have little relevance to the estimation of adaptation with Ornstein-Uhlenbeck models for three reasons. First, we point out that Cooper et al. (2016) did not consider the detection of distinct optima (e.g. for different environments), and therefore did not evaluate the standard test for adaptation. Second, we show that consideration of parameter estimates, and not just statistical significance, will usually lead to correct inferences about evolutionary dynamics. Third, we show that bias due to measurement error can be corrected for by standard methods. We conclude that Cooper et al. (2016) have not identified any statistical problems specific to Ornstein-Uhlenbeck models, and that their cautions against their use in comparative analyses are unfounded and misleading. [adaptation, Ornstein-Uhlenbeck model, phylogenetic comparative method.].

PMID:37229537 | DOI:10.1093/sysbio/syad012

Categories
Nevin Manimala Statistics

Improving the Accuracy, Robustness, and Dynamic Range of Digital Bead Assays

Anal Chem. 2023 May 25. doi: 10.1021/acs.analchem.3c00918. Online ahead of print.

ABSTRACT

We report methods that improve the quantification of digital bead assays (DBA)─such as the digital enzyme-linked immunosorbent assay (ELISA)─that have found widespread use for high sensitivity measurement of proteins in clinical research and diagnostics. In digital ELISA, proteins are captured on beads, labeled with enzymes, individual beads are interrogated for activity from one or more enzymes, and the average number of enzymes per bead (AEB) is determined based on Poisson statistics. The widespread use of digital ELISA has revealed limitations to the original approaches to quantification that can lead to inaccurate AEB. Here, we have addressed the inaccuracy in AEB due to deviations from Poisson distribution in a digital ELISA for Aβ-40 by changing the AEB calculation from a fixed threshold between digital counting and average normalized intensity to a smooth, continuous combination of digital counting and intensity. We addressed issues with determining the average product fluorescence intensity from single enzymes on beads by allowing outlier, high intensity arrays to be removed from average intensities, and by permitting the use of a wider range of arrays. These approaches improved the accuracy of a digital ELISA for tau protein that was affected by aggregated detection antibodies. We increased the dynamic range of a digital ELISA for IL-17A from AEB ∼25 to ∼130 by combining long and short exposure images at the product emission wavelength to create virtual images. The methods reported will significantly improve the accuracy and robustness of DBA based on imaging─such as single molecule arrays (Simoa)─and flow detection.

PMID:37229528 | DOI:10.1021/acs.analchem.3c00918

Categories
Nevin Manimala Statistics

Pilot study of an arts- and theatre-based HIV prevention intervention for men who have sex with men and transgender women migrants in South Africa: acceptability, feasibility and preliminary efficacy

Health Educ Res. 2023 May 25:cyad021. doi: 10.1093/her/cyad021. Online ahead of print.

ABSTRACT

Innovative approaches addressing the elevated human immunodeficiency virus (HIV) risk among men who have sex with men (MSM) or transgender women (TGW) migrants in South Africa are urgently needed. We sought to present the acceptability, feasibility and preliminary efficacy of ‘Externalize and Mobilize!’, a multi-session arts- and theatre-based HIV prevention group intervention for MSM and TGW migrants in South Africa. Fourteen participants-MSM (n = 7; 50%), genderqueer/nonbinary persons (n = 4; 29%) and TGW (n = 3; 21%)-in Cape Town were recruited and enrolled in the intervention and administered pre- and post-intervention assessments of HIV knowledge, HIV risk-reduction self-efficacy, stigma and resilience. The intervention, delivered over 4 days, was completed by all 14 participants. Scores on HIV knowledge and HIV risk-reduction self-efficacy were statistically significantly higher at post-intervention compared with pre-intervention. Additionally, participants responded affirmatively (i.e. ‘Agree’ or ‘Strongly agree’) on all items assessing intervention acceptability. Findings demonstrate the high acceptability, feasibility and preliminary efficacy of an arts- and theatre-based intervention for increasing HIV knowledge and HIV risk-reduction self-efficacy among MSM and TGW migrants in South Africa. This study provides further support for the use of creative and innovative interventions to address entrenched HIV disparities in South Africa.

PMID:37229526 | DOI:10.1093/her/cyad021

Categories
Nevin Manimala Statistics

Using an individualized pain management plan for African American adults with sickle cell disease

J Am Assoc Nurse Pract. 2023 May 25. doi: 10.1097/JXX.0000000000000885. Online ahead of print.

ABSTRACT

BACKGROUND: The increased lifespan of individuals having sickle cell disease (SCD) causes an overall increase in hospitalizations and more instances in which pain may not be well controlled.

LOCAL PROBLEM: The mainstay treatment for severe pain is opioids and the underlying cause. Laws affecting opioid prescribing, implicit bias, racial inequity, poor research funding, and lack of knowledge contribute to poor patient outcomes.

METHOD: Data were collected retrospectively using electronic medical record data from before and after the intervention.

INTERVENTION: The individualized pain management plan (IPMP) was initiated in collaboration with the patient, pain nurse practitioner (NP), and hematologist.

RESULT: The mean length of stay for the traditional pain management plan (TPMP) was 7.89 days compared with 5.66 days for the IPMP, with a mean difference of 2.23 days, t = 2.278, p = .024 (p < .05). There was a decrease in the admission of the individuals with the IPMP, with 25% readmitted within 30 days of discharge, versus 59.0% who were readmitted using the TPMP. Chi-square showed statistical significance (χ2 = 61.667, p = .000) in using nonpharmacological interventions with the IPMP group.

CONCLUSION: The IPMP with a patient-centered approach did improve patient outcomes for African American adults living with SCD.

PMID:37229519 | DOI:10.1097/JXX.0000000000000885

Categories
Nevin Manimala Statistics

Understanding the Effects of Constraint and Predictability in ERP

Neurobiol Lang (Camb). 2023 Apr 11;4(2):221-256. doi: 10.1162/nol_a_00094. eCollection 2023.

ABSTRACT

Intuitively, strongly constraining contexts should lead to stronger probabilistic representations of sentences in memory. Encountering unexpected words could therefore be expected to trigger costlier shifts in these representations than expected words. However, psycholinguistic measures commonly used to study probabilistic processing, such as the N400 event-related potential (ERP) component, are sensitive to word predictability but not to contextual constraint. Some research suggests that constraint-related processing cost may be measurable via an ERP positivity following the N400, known as the anterior post-N400 positivity (PNP). The PNP is argued to reflect update of a sentence representation and to be distinct from the posterior P600, which reflects conflict detection and reanalysis. However, constraint-related PNP findings are inconsistent. We sought to conceptually replicate Federmeier et al. (2007) and Kuperberg et al. (2020), who observed that the PNP, but not the N400 or the P600, was affected by constraint at unexpected but plausible words. Using a pre-registered design and statistical approach maximising power, we demonstrated a dissociated effect of predictability and constraint: strong evidence for predictability but not constraint in the N400 window, and strong evidence for constraint but not predictability in the later window. However, the constraint effect was consistent with a P600 and not a PNP, suggesting increased conflict between a strong representation and unexpected input rather than greater update of the representation. We conclude that either a simple strong/weak constraint design is not always sufficient to elicit the PNP, or that previous PNP constraint findings could be an artifact of smaller sample size.

PMID:37229506 | PMC:PMC10205153 | DOI:10.1162/nol_a_00094

Categories
Nevin Manimala Statistics

Global burden of chronic respiratory diseases and risk factors, 1990-2019: an update from the Global Burden of Disease Study 2019

EClinicalMedicine. 2023 May;59:101936. doi: 10.1016/j.eclinm.2023.101936.

ABSTRACT

BACKGROUND: Updated data on chronic respiratory diseases (CRDs) are vital in their prevention, control, and treatment in the path to achieving the third UN Sustainable Development Goals (SDGs), a one-third reduction in premature mortality from non-communicable diseases by 2030. We provided global, regional, and national estimates of the burden of CRDs and their attributable risks from 1990 to 2019.

METHODS: Using data from the Global Burden of Diseases, Injuries, and Risk Factors Study (GBD) 2019, we estimated mortality, years lived with disability, years of life lost, disability-adjusted life years (DALYs), prevalence, and incidence of CRDs, i.e. chronic obstructive pulmonary disease (COPD), asthma, pneumoconiosis, interstitial lung disease and pulmonary sarcoidosis, and other CRDs, from 1990 to 2019 by sex, age, region, and Socio-demographic Index (SDI) in 204 countries and territories. Deaths and DALYs from CRDs attributable to each risk factor were estimated according to relative risks, risk exposure, and the theoretical minimum risk exposure level input.

FINDINGS: In 2019, CRDs were the third leading cause of death responsible for 4.0 million deaths (95% uncertainty interval 3.6-4.3) with a prevalence of 454.6 million cases (417.4-499.1) globally. While the total deaths and prevalence of CRDs have increased by 28.5% and 39.8%, the age-standardised rates have dropped by 41.7% and 16.9% from 1990 to 2019, respectively. COPD, with 212.3 million (200.4-225.1) prevalent cases, was the primary cause of deaths from CRDs, accounting for 3.3 million (2.9-3.6) deaths. With 262.4 million (224.1-309.5) prevalent cases, asthma had the highest prevalence among CRDs. The age-standardised rates of all burden measures of COPD, asthma, and pneumoconiosis have reduced globally from 1990 to 2019. Nevertheless, the age-standardised rates of incidence and prevalence of interstitial lung disease and pulmonary sarcoidosis have increased throughout this period. Low- and low-middle SDI countries had the highest age-standardised death and DALYs rates while the high SDI quintile had the highest prevalence rate of CRDs. The highest deaths and DALYs from CRDs were attributed to smoking globally, followed by air pollution and occupational risks. Non-optimal temperature and high body-mass index were additional risk factors for COPD and asthma, respectively.

INTERPRETATION: Albeit the age-standardised prevalence, death, and DALYs rates of CRDs have decreased, they still cause a substantial burden and deaths worldwide. The high death and DALYs rates in low and low-middle SDI countries highlights the urgent need for improved preventive, diagnostic, and therapeutic measures. Global strategies for tobacco control, enhancing air quality, reducing occupational hazards, and fostering clean cooking fuels are crucial steps in reducing the burden of CRDs, especially in low- and lower-middle income countries.

PMID:37229504 | PMC:PMC7614570 | DOI:10.1016/j.eclinm.2023.101936

Categories
Nevin Manimala Statistics

Optimization of spray dried yogurt and its application to prepare functional cookies

Front Nutr. 2023 May 9;10:1186469. doi: 10.3389/fnut.2023.1186469. eCollection 2023.

ABSTRACT

INTRODUCTION: Spray-dried yogurt powder (SDYP) has shelf stability and other functional properties that improve solubility and facilitate the use, processing, packaging, and transportation of other food derivatives, such as bread and pastries on a large scale. The present research was conducted to develop SDYP and further its utilization to prepare functional cookies.

METHODS: Yogurt was spray-dried by employing different outlet air temperatures (OAT) (65°C, 70°C & 75°C) and inlet air temperature (IAT) (150°C, 155°C & 160°C). Spray drying shows that increasing the temperature increases nutritional loss, whereas S. thermophilus culture shows resistance to the intensive heat approaches. On the other hand L. delbrueckii subsp. Bulgaricus culture was found to be significantly affected. A total of 4 treatments, including one control for the functional cookies development.

RESULTS AND DISCUSSION: A directly proportional relation was investigated between the increasing concentration of SDYP and baking characteristics and cookie’s mineral and protein profile. Bioactive parameters like antioxidant activity of 2,2-diphenyl-1-picryl-hydrazyl-hydrate (DPPH), 2,2′-azino-bis (3-ethylbenzothiazoline-6-sulfonic acid (ABTS) and total phenolic content (TPC) were also affected significantly. The sensory profile shows an incline towards T0 (0% SDYP) to T3 (10% SDYP) in all attributes but starts to decline when the concentration of SDYP reaches 15%. This study suggests that by employing a certain combination of temperatures (OAT: 60°C IAT: 150°C); maximum survival of inoculated culture can be achieved, and this powder can be utilized in the development of functional cookies with enhanced sensory as well as biochemical characteristics significantly (P< 0.05).

PMID:37229469 | PMC:PMC10204867 | DOI:10.3389/fnut.2023.1186469