SCROLL NEWS / DISCOVERY
Search headlines
Find the stories shaping the conversation.
Results for " multimodal " 23 found 🔀 AI-powered Shuffle
mIRage-LS - Multimodal submicron IR imaging & spectroscopy for life science research
The mIRage-LS combines sub-500 nm O-PTIR with co-located fluorescence microscopy for advanced life science research.
Minaris Adds Dedicated Viral Vectors Business Unit, Splitting Into Three Specialized Divisions
Minaris, the Philadelphia-based global cell and gene therapy CDMO and multimodal contract testing organization, announced on September 29, 2026 the addition…
Minaris Evolves Business Model with Addition of Dedicated Viral Vectors Business Unit
/PRNewswire/ -- Minaris, a global cell and gene therapy (CGT) CDMO and multimodal contract testing organization, today announced the addition of a dedicated...
Max Planck Stanford Centre to be established
Max Planck Institute for Informatics and Stanford School of Engineering will establish a joint AI research hub, the Max Planck Center for Visual and Multimodal Artificial Intelligence. The partnership will explore the foundations of next-generation AI systems.
Governor appoints Mark Wright as DOTD Commissioner of Multimodal Commerce
The Louisiana Department of Transportation and Development announces that Governor Jeff Landry has appointed State Representative Mark Wright as Commissioner of DOTD’s Office of Multimodal Commerce.
Continual integration of single-cell multimodal data with MIRACLE
Nature Computational Science - MIRACLE is an online continual learning framework that efficiently integrates single-cell multimodal data across batches, modalities, tissues, and diseases.
Spatial transcriptome for cell segmentation
Nature Computational Science - A diffusion-based multimodal framework called DISSECT leverages transcriptomic gradients to refine segmentation boundaries, enabling high-precision single-cell...
Google Introduces Gemini Omni, a Multimodal AI That Knows the World
Starting with video, Omni will eventually be able to create any output from any input.
Google's Gemini Omni turns images, audio, and text into video — and that's just the start
Google's Gemini Omni is a new multimodal model that reasons across text, images, audio, and video to generate and edit videos through simple conversation — starting with Omni Flash.
At HCA Healthcare, small ideas go big in fight to stop overdoses
From drug take-back events to multimodal post-op pain control, physicians see their innovations take hold to benefit patients and communities.
Spanberger signs bipartisan bills tied to billions in business investment across Virginia
Gov. Abigail Spanberger on Monday signed a package of economic development bills aimed at securing billions of dollars in private investment and creating thousands of jobs across Virginia, highlighting projects in Southside and Central Virginia tied to manufacturing, energy infrastructure and pharmaceuticals.The legislation supports several major projects announced by the administration in February, including a more than $500 million investment in Pittsylvania County by Avio USA Inc. The company plans to build an 860,000-square-foot manufacturing facility at the Southern Virginia Multimodal Park in the town of Hurt.
Google Just Released Gemma 4: Why This Open-Source AI is a Game Changer
Google positions Gemma 4 for workstation and edge deployment, with E2B/E4B models offering 128K context for low-latency on-device apps.
Google's Gemma 4 model goes fully open-source and unlocks powerful local AI
Now open-source under Apache 2.0, Gemma 4 brings offline, multimodal AI to servers, phones, and Raspberry Pi - giving developers total local control over edge and on-premises deployments.
Multimodal Fusion Used In Self-Driving Cars Is Uplifting AI That Provides Mental Health Guidance
AI uses text to converse on mental health aspects. We are moving to multimodal interactions. Fusion is crucial. Especially for mental health chats. An AI Insider scoop.
Vanderbilt Lung Transplant Program sets new record
The Vanderbilt Transplant Center is now the second largest lung transplant center in the United States by volume, with 149 lung transplants in 2025, the most ever in one year at Vanderbilt Health. The Vanderbilt Lung Transplant Program leads the nation in organ preservation and regeneration and is among the best in long-term outcomes, demonstrating the success of the interdisciplinary team in caring for these complex patients. Several features make the program unique in the United States, said Konrad Hoetzenecker, MD, PhD, professor of Thoracic Surgery and surgical director of the Vanderbilt Lung Transplant Program. Vanderbilt serves as a “second opinion center” and accepts most complex candidates that are turned down by other centers due to increased perioperative risk. This includes patients over 70 years old, patients requiring combined procedures with their transplant, multiorgan transplantations and sensitized patients (individuals who have pre-formed anti-HLA antibodies who are at higher risk for complications). The expertise and excellent outcomes have attracted patients far beyond the borders of Tennessee; almost half of Vanderbilt Health’s lung transplant recipients come from out of state. “Another unique feature is our minimally invasive transplant program,” Hoetzenecker said. “By using distinct surgical instruments and techniques, the incisions can be kept as small as 7 to 8 centimeters, which results in better healing, less pain and faster recovery. “This minimally invasive approach is embedded in an Enhanced Recovery After Surgery (ERAS) protocol, a multimodal, evidence-based perioperative care pathway designed to reduce surgical stress, minimize complications and speed up recovery. Our unique ERAS protocol, by a dedicated interdisciplinary approach, aims to improve recovery after lung transplant and reduce ICU and hospital stay.” The lung transplant program recently celebrated a milestone — 1,000 lung transplants since the program began in 1990. “This significant achievement reflects the concerted effort of a multidisciplinary collaboration by the Departments of Thoracic Surgery, Medicine, Anesthesiology and Critical Care,” said David Erasmus, MD, associate professor of Medicine and medical director of Vanderbilt Lung Transplant. Lung transplants have been attempted since the 1960s, but they were largely unsuccessful until the 1980s, when surgical techniques were refined and new antirejection drugs proved effective. Patient outcomes steadily improved from the 1990s to the present. Vanderbilt’s fourth lung transplant recipient in 1990, Pam Everett, is the longest-living, single-lung transplant known in the world, recently celebrating 35 years since her transplant. The Vanderbilt Lung Transplant surgical team is led by Hoetzenecker and Caitlin Demarest, MD, PhD, the surgical director and associate surgical director of the Vanderbilt Lung Transplant program. Erasmus is the medical director of Vanderbilt Lung Transplant along with Anil Trindade, MD, associate medical director and associate professor of Medicine.
Your Thymus and Your Healthspan
Our thymus gland plays a central role in the development or our immune system, specifically for supporting T cell development (how these cells got their name, maturation and differentiation in the thymus) and discriminating between self and foreign, non-self antigen proteins with production of dendritic cells. As we age, our thymus gland shrinks—the process known as involution—with progressive change from spongy to fatty tissue, with loss of functionality. But this process, with respect to timeline and extent, markedly varies from one person to the next. And to make things even more complicated, our thymus gland anatomy and precise location in the chest also is highly variable. So the famous Frank Netter diagrams from the 1960s (such as at left below) don’t capture the remarkable heterogeneity that a random set of 12 chest CT scans (below at right). What I consider as 2 landmark papers in Nature this week (here and here) used AI to quantify health of the thymus in 2 large cohorts, and then correlate the metric to a broad array of health outcomes. In this edition of Ground Truths, I’m going to cover three questions: (1) How was thymus health determined by AI?; (2) How is thymus health linked to key clinical outcomes? and (3) Are there ways we can promote a healthy (aka rejuvenate) thymus gland in our later years? Subscribe 1. How was thymus health determined by AI? This was accomplished by extensive work developing and validating an AI pipeline for 2 stages, the first for localization and segmentation of the thymus bed, and the second to quantify a digital marker, termed the thymic health score. There’s a lot to this algorithmic development, so I won’t go into all the details, but just provide a rudimentary outline of what was done. The 1st stage used supervised learning with 2 radiologists reviewing 2,461 chest CT scans. That work trained a 3D U-Net model to automatically identify the thymic bed’s 3D cropped region using center of mass coordinates, which reached 99.8% accuracy. The 2nd stage used a foundation model that was pre-trained with SwAV (which stands for Swapping Assignment between multiple Views), a self-supervised model, that generated a high-dimensional thymus representation of 4,096 features. That compares to the radiology reductionist and subjective scoring of 0 to 3 where 0 means the thymus is fully degenerated and fatty, and 3 is considered dense, intact glandular soft tissue. Notably, the self-supervised learning (SSL) performance was superior to supervised (AUC ~0.75 vs 0.55, respectively) reflecting the shallowness of the 0-3 classifier vs SSL’s holistic, self-taught AI. The thymic health score ranged from 0 to 100, with the highest number indexed to fully preserved thymic health. The algorithmic work extended to explainability with both Shapely value distribution, meaning the model was holistic not relying on any “magic” pixel, and occlusion sensitivity, demonstrating the model’s performance was not affected by ribs, sternum, lung tissue, but rather focused on the thymic bed directly. Below are a few saliency maps from the occlusion sensitivity that indicate the thymic bed focus, not affected by neighboring structures, using the jet color scale. Now the AI was ready for processing ~25,000 CT scans, each over 30 MB files, from the 2 large participant cohorts to provide a thymic health score, it did so in less than 14 hours, which is less than 2 seconds per scan! Share 2. How is thymus health linked to key clinical outcomes? The two cohorts were the National Lung Screening Trial, NLST (N=25,031) and the Framingham Heart Study, FHS (N=2,581) each with baseline demographics and long term follow up of >12 years for health outcomes. From the NSLT, you can see below that increased age and body-mass index were correlated to reduced thymic health. And, overall, men had reduced thymic health scores compared with women. There are a lot of graphs in the paper for outcomes, for both the NLST and FHS cohorts. To simplify the major outcomes, below is a composite Figure with striking reduction of all-cause mortality and for the different causes of death. The results were consistent between the 2 cohorts. For example, the cardiovascular mortality hazard ratio average was 0.57 in NLST and 0.38 in FHS (weighted to be 0.53 for the aggregate). The reduction of mortality also extended to digestive diseases and pulmonary disease (data not shown below). Lung cancer incidence was reduced by 36% for high vs low thymic health (Figure below, with a panel -incidence and b panel-mortality, adjusted for age, sex, BMI, smoking status). Notably, there was a smoker’s paradox: lower incidence and improved survival for lung cancer in smokers who had a high thymus health score. Smoking was associated with lower thymic scores whereas alcohol was not. Higher thymic health was linked to higher HDL cholesterol, lower triglycerides, lower fasting blood glucose, and lower systolic and diastolic blood pressure. Inflammation biomarkers, such as C-reactive protein and interleukin-6, were elevated in the people with lower thymic health scores. In their second paper, the same team looked at the relationship between thymic score and outcomes for 3,476 patients receiving cancer immunotherapy. The non-small cell lung cancer progression-free survival was reduced in patients with low thymic health score. A parallel relationship for survival was seen for other types of cancer including melanoma, breast, and kidney with a 44% lower risk among high thymic scores (Figure). A similar pattern was seen with different immune checkpoint inhibitors. The thymus health score outperformed programmed death ligand-1 (PD-L1)and tumor mutation burden (TMB) assay of the tumor and was an independent prognostic marker of progression-free survival. In this dataset, a direct connect with thymus score and adaptive immune function was noted with a correlation before cancer treatment for both T-cell diversity and thymus T-cell production (a metric known as T cell receptor excision circles). Thymus Removal Study There is a highly relevant citation about thymus function before moving onto ways to rejuvenate it. In 2023, a very important study of thymus removal during cardiothoracic surgery was published, with 1146 patients undergoing thymus removal vs 1146 matched controls (mean age 55 years). The adverse outcomes for thymus removal were striking, with a 2.9 higher risk of all-cause mortality and doubling of cancer incidence, 1.5 fold increase in cancer mortality, and 1.5-fold increase in autoimmune diseases. The immune function showed marked compromise after thymus removal, as reflected by CD4+ and CD8+ T cells (Figure below) Share Ground Truths 3. Are there ways we can promote a healthy (aka rejuvenate) thymus gland in our later years? In recent months we’ve learned a lot about the process of thymus involution and the pathways by which this may be modulated. Thymus involution is primarily due to loss to thymus epithelial cells (TECs) and there are 2 subtypes with different functions: the cortical, responsible for positive selection of T cells, and the medullary, for negative selection. When adipose tissue infiltrates the thymus, thymic adipocytes are pro-inflammatory, knocking out T-cell output. Likewise, systemic inflammation, or “inflammaging,” from smoking, obesity, and chronic stress promote thymic adipocytes. Now, from preclinical studies, we know about key pathways that account for these processes. Historically, back in 2014, FOXN1 was recognized as a single master transcription factor essential for TEC function, with studies in mice with forced FOXN1 upregulation leading to thymus regeneration. That laid the foundation for potential regrowth of quiescent thymus cells. It took awhile to find pathways to accomplish this goal and to even refute its role as the master regulator. The Liver-Thymus Axis Feng Zhang and his team recently showed that injection of an mRNA vaccine to the liver encoding DLL1, IL-7 and FLT3-L in combination, factors known to support thymopoiesis (Figure), successfully enhanced immune function in aged mice. However, the effect was transient. The FGF21 Story Two reports in 2025 addressed the thymus gland’s production of FGF21, a growth factor (fibroblast growth factor 21) and its control of thymus involution. This growth factor is also produced by the liver, but it doesn’t have impact on the thymus in aged rodent models. In contrast, The liver’s hepatocyte growth factor (HGF) has been shown to reverse senescent TEC structural changes. Growth hormone stimulates production of insulin growth factor-1 (IGF-1) in the liver and the thymus. Two small studies in human participants (TRIIM, for Thymus Regeneration, Immunorestoration, and Insulin Mitigation) of 6 and 50 people, respectively, treated with combined human growth hormone, metformin and DHEA, suggested the potential of slowing epigenetic aging and improving thymus mass and function. But the combination of drugs, small sample, and lack of controls make conclusions murky. Increased thymus FGF21 led to increased CD8 T cells in old mice and extended healthspan and improved physical performance. Building on the previous FOXN1 data, ablation of β-klotho, the obligatory co-receptor for FOXN1, accelerated thymic aging. The benefit to FGF21 was confirmed in a companion paper using an FGF21 knock-in mouse model showing thymus enlargement and increased TECs throughout the lifespan. (schematic Figure below). The accompanying editorial for these 2 papers speculated: “The proposed link between age-associated thymus involution and organismal aging is intriguing, and suggests we might seek to achieve systemic rejuvenation by counteracting thymic involution.” Other Factors Lessons from the Axolotl (Mexican Salamander) In an elegant set of experiments of the axolotl (Figure), known for its complete thymus regeneration after total surgical removal, mediators were identified. Surprisingly FOXN1 was dispensable. But midkine, a growth factor, appeared to be the driver, the initiator of thymus cell growth, survival, and repair. Other components that contributed were Postn+ (periostin-expressing mesenchymal niches) and Ccl19, a chemokine protein from the bloodstream. RANK and RANKL RANK (receptor activator of nuclear factor κB its ligand (RANKL) have been considered key regulators of medullary TECs. In a study of both aged mice and human thymus cell cultures, their key role was confirmed, with multiple benefits of resorting TEC function, recruitment of progenitor cells, and T cell development. Subscribe Summing Up This body of work strongly supports the health of the thymus gland as a critical regulator of human healthspan, not just a correlate or link. The new landmark studies are reinforced by the regenerative biology experimental models that have shown, via an array of mediators, that healthspan of aged mice is at least in part dependent on thymus gland function and its critical role for maintaining adaptive immunity. It sure seems that we’d be better off having an immune reservoir of naive T cells instead of a profile in older adults of exhausted, low quality, memory T cells, with a senescent phenotype. It is striking that we ignored the importance of the thymus gland for many decades. A wake-up call was the results of the thymectomy matched control study reviewed here, with the opposite of high thymic health score improved health outcomes. The convergence of AI and healthspan here is notable. The exceptional and laborious work for developing and validating (no less explaining) the AI to quantify thymus health set the foundation for probing the connect the major health outcomes in two cohorts with extensive follow-up. We’ve never had a way to meaningfully quantify the thymus gland before, so this represents important leverage of supervised, self-supervised, and transformer models. The study wouldn’t have been possible without AI. And it begs the question as to whether there are ways we can maintain our thymus at a high health score. But it’s not so simple to rejuvenate our thymus. There are multiple risks including the induction of autoimmunity, increasing the risk of cancer, and inducing a pro-inflammatory state. For example, factors that increase TEC proliferation could compromise the medulllary negative selection process and leak out auto-reactive (self-attacking) T cells. Thymic cells could be induced to proliferate, but we know, for example, that growth hormone and IGF-1 are associated with an increase risk of cancer. If thymus rejuvenation doesn’t clear out the accumulated senescent cells in older adults, then inflammation within the gland could block the production of TECs. Keeping these risks in mind, we now have identified many ways to keep our thymus healthy as we age that undoubtedly will be tested in clinical trials going forward. Ultimately, the benefit-to-risk tradeoffs will be defined. In the meantime, we have desperately needed an immunome. As I’ve stressed in multiple prior Ground Truths, we have no test in the clinic to assess a patient’s immune status! It was very encouraging for me to get an email from Hugo Aerts, the senior author of the landmark papers in the days after they were published: “I also wanted to say that your Substack on “Why We Need an Immunome” was inspiring for this work. We found it a very compelling perspective and greatly enjoyed reading it.” Just having an assessment of a person’s immune status via a chest CT scan, with millions of these performed per year, might help in guiding the right immunotherapy for cancer (e.g. more intensive, combinations for those with low thymic health scores) and help define people who are increased risk for age-related diseases of cancer, cardiovascular, and neurodegenerative. The main theme of Super Agers is that we now have many layers of data (genetics, proteins, biomarkers, organ clocks that can be integrated via multimodal AI) for us to define a person’s specific risk decades before one of these age-related diseases leads to symptoms, enabling prevention. From the new studies this week, we can add thymus health score as yet another way to understand a person’s risk, a window into their adaptive immune system and healthspan. And perhaps someday we will be able to safely rejuvenate the thymus, or maintain its health through one’s life, and use the thymus health score to monitor. NB: I wrote this post (No A.I.) A Quick Poll Loading... ********************************************************************* Thanks to Ground Truths subscribers (now > 200,000) from every US state and 212 countries. Your subscription to these free essays and podcasts makes my work in putting them together worthwhile. Please join! If you found this interesting PLEASE share it! Share Ground Truths Paid subscriptions are voluntary and all proceeds from them go to support Scripps Research. They do allow for posting comments and questions, which I do my best to respond to. Please don’t hesitate to post comments and give me feedback. Let me know topics that you would like to see covered. Leave a comment Many thanks to those who have contributed—they have greatly helped fund our summer internship programs for the past two years. It enabled us to accept and support 47 summer interns in 2025! We aim to accept even more of the several thousand who will apply for summer 2026.
Multimodal embeddings at scale: AI data lake for media and entertainment workloads
This post shows you how to build a scalable multimodal video search system that enables natural language search across large video datasets using Amazon Nova models and Amazon OpenSearch Service. You will learn how to move beyond manual tagging and keyword-based searches to enable semantic search that captures the full richness of video content.
Scientists build a “periodic table” for AI
Choosing the right method for multimodal AI—systems that combine text, images, and more—has long been trial and error. Emory physicists created a unifying mathematical framework that shows many AI techniques rely on the same core idea: compress data while preserving what’s most predictive. Their “control knob” approach helps researchers design better algorithms, use less data, and avoid wasted computing power. The team believes it could pave the way for more accurate, efficient, and environmentally friendly AI.
The End of Language As We Know It? Scientists Challenge 60 Years of Linguistic Research
An international team proposes replacing Hockett’s feature checklist with a model of language as a dynamic, multimodal, and socially evolving system.
Driving large-scale hearing and balance research through data science investments, and an update on NIDCD’s January Advisory Council meeting
Enabling access to large-scale multimodal databases is essential to advancing science across all institutes at NIH. As both datasets and analytical methods become more complex, proper data infrastructure can enable multidisciplinary research efforts at a scale greater than that of individual studies alone. In line with NIH-wide strategic plans, NIDCD is making investments in data science that address long-standing research gaps, provide important resources for the research community, and preserve and protect participant privacy and data security.
Quantum spin resonance in engineered proteins for multimodal sensing
Nature - A recently developed class of magneto-sensitive fluorescent proteins are engineered to alter the properties of their response to magnetic fields and radio frequencies, enabling multimodal...
Societies must adapt to the rise of multimodality cardiac imaging
ASE President David Wiener detailed some of the many ways imaging societies need to adapt now that so many imagers are specializing in multiple modalities. It may be time to change how annual conferences are scheduled, for example, so that the costs of travel are easier to manage.
I wore Google's upcoming Android XR smart glasses, and it's a future I'd actually want to live in
From multimodal AI glasses to immersive headsets, Google's Android XR vision is more ambitious - yet clearer - than ever.