Junichiro Iwasawa

Researcher at Preferred Networks Inc.

iwasawa [at] preferred.jp

Research

My research spans several interdisciplinary areas, ranging from physics, biology to machine learning.

Large Language Models for Healthcare

As part of my work at Preferred Networks, I've been leading projects focused on applying Large Language Models (LLMs) to healthcare challenges. This includes developing specialized medical LLMs that can understand and generate domain-specific knowledge, assisting healthcare professionals in diagnosis, and enhancing patient care through natural language processing. A major achievement was the development of medical domain-specialized LLMs, including Llama3-Preferred-MedSwallow-70B and Preferred-MedLLM-Qwen-72B, which are the first open LLMs to surpass GPT-4 in the Japanese Medical Licensing Exam (JMLE). These models demonstrate the potential for LLMs to serve as valuable tools in healthcare settings, providing accurate medical information and supporting clinical decision-making.

Deciphering evolutionary constraints of Escherichia coli

The prediction and control of evolution is a crucial topic for both evolutionary biology and tackling antibiotic resistance. Although the lack of sufficient data has long hindered the mechanism of evolution, laboratory evolution experiments equipped with high-throughput sequencing/phenotyping are now gradually changing this situation. The emerging data from recent laboratory evolution experiments revealed repeatable features in evolutionary processes, suggesting the existence of constraints which could lead to actual predictions of evolutionary outcomes. These results also paint an upbeat picture of evolution: biologically feasible states and evolutionary trajectories could be distributed on a low-dimensional manifold within the high-dimensional space spanned by biological features. By combining machine learning techniques with experimental data from high-throughput laboratory evolution experiments, we aim to decipher the constraints which cause the low-dimensional evolutionary dynamics.

Related Publications:

Collective phenomena of active colloidal particles (Janus particles)

Collective motion can be observed in a wide variety of systems, from flocks of birds to the collective migration of living cells. The ubiquitousness of this collective phenomena strongly hints the existence of universal properties which can be explained from basic features of the system, and thus has motivated physicists for the past few decades leading to a field which is now called Active Matter. Janus particles, which are asymmetric colloidal particles with distinct hemispheres with different physical properties, can function as self-propelled particles by dissipating energy to the surrounding fluid under an AC electric field. Since they provide a perfect test bed for active matter research, Janus particles have increasingly gained attention in the field of active matter through the past decade. We have explored universal features of collective motion through the active dynamics of Janus particles.

Related Publications:

Medical image analysis in the small data regime

Although neural networks are emerging in a wide range of topics, the preparation of sufficient data still remains as a hurdle to overcome, especially for biological/medical data. Recently, self-supervised learning has been suggested as an effective pre-training method for various fields such as natural language processing and image classification. The idea of self-supervised learning is to utilize unlabeled data to improve task performance when only a few labeled data is available through the utilization of pre-text tasks. However, self-supervised learning requires heavy computing before the main task, which could be a burden in certain scenarios. We have been working on methods where pre-text tasks could be utilized as auxillary tasks for regularizing segmentation models in the small labeled data regime, making the learning process more data and cost-efficient.

Related Publications: