Connect with us

Hi, what are you looking for?

AI Technology

Penn Engineers Introduce AI Method Reducing Memory Use 10x for Solving Complex Math Problems

University of Pennsylvania engineers unveil “Mollifier Layers,” achieving a 10x reduction in memory use for solving complex inverse PDEs, enhancing scientific inference.

Engineers at the University of Pennsylvania have developed a novel approach to solving complex scientific problems by harnessing artificial intelligence. Their method, termed “Mollifier Layers,” targets the challenge of inverse partial differential equations (inverse PDEs), a class of equations crucial in fields like weather systems, biology, and materials science. The findings, which will be presented at NeurIPS 2026, represent a departure from traditional AI strategies that prioritize model size and computational power.

Inverse PDEs pose a significant challenge for researchers as they require working backward from observable outcomes to deduce the underlying causes. Vivek Shenoy, the senior author of the research and the Eduardo D. Glandt President’s Distinguished Professor in Materials Science and Engineering, illustrates this by comparing it to deciphering the cause of ripples in a pond. “You can see the effects clearly, but the real challenge is inferring the hidden cause,” he notes.

These equations are pivotal in understanding dynamic systems, helping scientists track changes such as heat movement, population growth, or chemical processes. However, they flip the conventional approach by starting with observations rather than known rules, complicating the inference of hidden parameters or dynamics. “We could see the structures and model their formation, but we could not reliably infer the epigenetic processes driving this system,” Shenoy explains, referring to their studies on chromatin, the folded state of DNA.

The core issue lies in differentiation—the mathematical method that measures change. Traditional AI systems calculate derivatives through recursive automatic differentiation, which can become inefficient and unstable, particularly with noisy data or higher-order derivatives. The Penn researchers found that as the complexity of systems increased, so did their computational burden. In one benchmark comparison, memory use surged from 0.21 gigabytes to 2.70 gigabytes when tackling a fourth-order reaction-diffusion problem using both data and PDE loss.

Realizing that traditional neural network design was not the primary barrier, the team pivoted to mollifiers, a mathematical tool dating back to the 1940s. Mollifiers smooth jagged or noisy functions, enhancing the stability of derivative calculations. Their innovative approach involves inserting a mollifier layer that first smooths the signal and then computes derivatives through fixed convolution-based operations. This adjustment alleviates the computational strain associated with recursive calculations and leads to more stable derivative estimates.

Testing the mollifier-based models on several benchmark problems, including a first-order 1D Langevin equation and a fourth-order 2D reaction-diffusion system, yielded impressive results. For instance, the mollified physics-informed neural network (PINN) achieved a temporal correlation of 0.97 for the Langevin case, significantly outperforming the standard PINN, which recorded a correlation of only 0.36. Memory consumption and training time also saw substantial reductions across all tested systems.

This advancement has implications that extend beyond mathematical modeling. For Shenoy’s lab, enhanced inference capabilities in chromatin structure can lead to a deeper understanding of gene expression, which is critical for areas such as cancer research and cellular aging. By enabling researchers to track how reaction rates evolve over time, the method opens pathways to potential new therapies that could influence how cells respond to various conditions.

The versatility of inverse PDEs means the Penn researchers’ framework could find applications across various scientific disciplines, from fluid mechanics to genetics. The authors suggest that the principles demonstrated could even enhance forward models and operator learning in artificial intelligence.

While the mollifier method offers promising solutions, it is not without limitations. The performance relies on the choice of mollifier kernel, which must strike a balance between suppressing noise and preserving essential features. Future research aims to explore adaptive kernels and boundary-aware formulations to enhance the method’s applicability.

This research signifies a step forward in the quest for efficient methods to extract hidden rules from complex scientific data. By improving the accuracy of parameter inference in noisy environments, it underscores the potential for AI to transform observational data into actionable insights, ultimately enabling scientists to decipher the intricate rules governing various systems. As Shenoy concludes, “If you understand the rules that govern a system, you now have the possibility of changing it.”

See also
Staff
Written By

The AiPressa Staff team brings you comprehensive coverage of the artificial intelligence industry, including breaking news, research developments, business trends, and policy updates. Our mission is to keep you informed about the rapidly evolving world of AI technology.

You May Also Like

AI Research

Seven leading Pennsylvania universities launch the Keystone AI + Quantum Factory to enhance supercomputing capabilities and drive innovation in AI and quantum research.

AI Regulation

Professor Cary Coglianese warns that while AI tools can aid federal agencies, they cannot supplant the essential human judgment needed for effective governance.

AI Research

NeurIPS reverses restrictions on Chinese researchers after backlash, potentially reshaping international AI collaboration amid rising geopolitical tensions.

AI Regulation

NeurIPS apologizes for a controversial policy barring submissions from 873 Chinese entities, amidst widespread boycotts from China's tech community.

AI Research

Indian American researcher Shreya Parchure uses explainable AI to personalize speech therapy, aiming to improve recovery for one-third of stroke survivors with aphasia.

Top Stories

University of Pennsylvania researchers unveil AI method identifying key tooth decay risk factors in children and seniors, enhancing preventive oral health measures.

Top Stories

Retail AI adoption surges as Walmart and Target unveil innovative tools, driving U.S. e-commerce traffic up 758% year-over-year, yet challenges remain.

AI Technology

Indian American engineers unveil the first U.S.-made monolithic 3D chip, achieving a 400% speed increase and revolutionizing AI hardware production.

© 2025 AIPressa · Part of Buzzora Media · All rights reserved. This website provides general news and educational content for informational purposes only. While we strive for accuracy, we do not guarantee the completeness or reliability of the information presented. The content should not be considered professional advice of any kind. Readers are encouraged to verify facts and consult appropriate experts when needed. We are not responsible for any loss or inconvenience resulting from the use of information on this site. Some images used on this website are generated with artificial intelligence and are illustrative in nature. They may not accurately represent the products, people, or events described in the articles.