Google AI Introduces PaperBanana: An Agentic Framework that Automates Publication-Ready Methodology Diagrams and Statistical Plots

Bridging the Gap Between Scientific Ideas and Visual Communication

In the rapidly evolving landscape of artificial intelligence research, scientists face an often-overlooked bottleneck: creating publication-quality illustrations. While AI systems have made remarkable strides in literature reviews, hypothesis generation, and even code development, the laborious task of designing methodology diagrams and statistical plots has remained stubbornly manual. This gap between technical breakthrough and visual communication represents a significant time sink for researchers who would rather focus on discovery than graphic design.

Enter PaperBanana, a groundbreaking agentic framework developed through a collaboration between Google Cloud AI Research and Peking University. This innovative system promises to transform how scientists create academic illustrations by automating the entire process from text description to publication-ready figure.

The Challenge of Scientific Illustration

Creating high-quality academic diagrams requires a unique combination of skills. Researchers must translate complex technical concepts into clear visual representations while adhering to aesthetic standards that vary across disciplines and venues. Traditional approaches have proven inadequate for this challenge.

Code-based solutions like TikZ and Python-PPTX offer precision but struggle with the specialized icons, custom shapes, and sophisticated visual elements that have become standard in modern AI publications. Meanwhile, direct image generation models can produce visually appealing results but frequently fail to meet the rigorous accuracy standards required for academic publishing. They often suffer from numerical hallucinations, where data values appear incorrect, or produce repeated elements that undermine scientific credibility.

## How PaperBanana Works: A Multi-Agent Approach

Rather than relying on a single monolithic model, PaperBanana orchestrates a collaborative team of five specialized AI agents, each handling a distinct aspect of the illustration generation process. This division of labor ensures that every stage benefits from dedicated expertise.

The Five-Agent Architecture

Retriever Agent: This agent serves as the system's memory, searching through a curated database to identify the most relevant reference examples. By analyzing 13 methodology diagrams spanning agent reasoning, vision perception, generative learning, and scientific applications, it establishes appropriate style and structural templates for the target figure.

Planner Agent: Acting as the cognitive core, this agent transforms raw technical text from methodology sections into detailed textual descriptions of the desired visualization. It interprets abstract concepts and determines how they should be represented graphically, deciding which elements deserve emphasis and how information should be hierarchically organized.

Stylist Agent: Academic aesthetics matter, and different research communities have distinct visual conventions. The Stylist Agent automatically synthesizes aesthetic guidelines by analyzing reference examples, ensuring diagrams align with contemporary academic standards. Rather than using harsh primary colors, for instance, it favors soft tech pastels that have become prevalent in recent AI publications.

Visualizer Agent: This agent handles the actual rendering, using state-of-the-art image generation models to transform textual descriptions into visual outputs. For statistical plots requiring numerical precision, it switches strategies entirely, generating executable Python code using Matplotlib rather than directly rendering images. This hybrid approach eliminates the numerical hallucination problem that plagues pure image generation.

Critic Agent: Quality assurance comes from this final agent, which meticulously inspects generated images against source material. It identifies factual errors, visual inconsistencies, and areas needing improvement, providing specific feedback that guides regeneration. This self-critique mechanism runs through three refinement cycles before producing final output.

The Dual-Phase Generation Process

PaperBanana's workflow divides into two distinct phases:

Linear Planning Phase: The system begins by retrieving relevant reference examples and establishing comprehensive aesthetic guidelines. The Planner and Stylist agents collaborate to create a detailed blueprint for the target illustration, ensuring both content accuracy and visual consistency with academic standards.

Iterative Refinement Loop: Following initial generation, the framework enters a three-round refinement cycle. The Critic agent examines each iteration with increasing scrutiny, evaluating faithfulness to source material, conciseness of presentation, readability of layout, and adherence to aesthetic principles. Based on this feedback, the Visualizer regenerates the image with progressive improvements.

Rigorous Evaluation: PaperBananaBench

To validate their framework, the research team introduced PaperBananaBench, a comprehensive benchmark comprising 292 test cases curated from accepted NeurIPS 2025 publications. This dataset represents real-world academic illustration challenges across four major research categories: Agent & Reasoning systems, Vision & Perception applications, Generative & Learning methods, and Science & Applications domains.

The benchmark construction involved careful filtering to ensure quality. The team extracted methodology sections, filtered for appropriate aspect ratios compatible with generation models, performed semantic categorization, and conducted manual curation to verify integrity. An additional 292 reference cases provide the system with examples to learn from. The average source context spans 3,020 words, while figure captions average 70 words, reflecting the complexity of real academic writing.

Performance Achievements

PaperBanana's results demonstrate substantial improvements over baseline approaches. Using a Vision-Language Model as Judge methodology, the framework was evaluated across four critical dimensions:

Faithfulness measures whether generated diagrams accurately represent all elements mentioned in source text. PaperBanana achieved a 2.8 percentage point improvement in this dimension, demonstrating strong content alignment.

Conciseness evaluates how effectively the system abstracts information without unnecessary verbosity. Here, PaperBanana showed its most dramatic gains with a 37.2 percentage point improvement, indicating the Critic Agent successfully eliminates extraneous visual elements that clutter understanding.

Readability assesses clarity of layout, label positioning, and overall visual hierarchy. The framework improved this metric by 12.9 percentage points, making diagrams easier to parse and comprehend.

Aesthetics represents the most subjective dimension, evaluating visual polish and adherence to contemporary design standards. PaperBanana achieved a 6.6 percentage point improvement by matching the sophisticated aesthetic conventions observed in recent NeurIPS publications.

Overall, the framework delivered a 17.0 percentage point improvement in aggregate scores compared to vanilla baseline approaches. In blind human evaluations, reviewers preferred PaperBanana outputs in 72.7% of cases when compared against alternatives, validating the system's effectiveness beyond automated metrics.

Performance varied across diagram categories. Agent & Reasoning diagrams received the highest overall score at 69.9%, while Vision & Perception diagrams proved most challenging at 52.1%. These variations reflect the inherent difficulty of different visualization types, with complex perceptual concepts requiring more nuanced visual treatment.

The Code vs. Image Generation Trade-off

For statistical plots, PaperBanana offers a revealing comparison between two approaches. Image generation models excel in producing aesthetically pleasing visualizations with sophisticated color schemes and modern design elements. However, they frequently introduce numerical errors, misplace data points, or repeat chart elements incorrectly.

Code-based generation using Matplotlib ensures perfect data fidelity. By writing executable Python code that programmatically constructs plots, the system guarantees that every bar height, data point position, and axis scale reflects actual values with mathematical precision. This approach proves essential for scientific accuracy, though it may sacrifice some aesthetic sophistication.

The framework allows researchers to choose between these modes based on their priorities. For exploratory analysis where approximate patterns matter more than exact values, image generation provides rapid, beautiful results. For publication-quality figures where numerical integrity is non-negotiable, code-based generation offers reliability.

Beyond Creation: Polishing Existing Diagrams

PaperBanana's capabilities extend beyond generating figures from scratch. The framework can enhance human-drawn diagrams, transforming rough sketches or outdated visuals into polished illustrations suitable for top-tier publications.

By applying auto-summarized aesthetic guidelines, the system systematically refines color palettes, typography, spacing, and iconography while preserving the original scientific content and logical structure. In comparative evaluations, these refined versions won aesthetic preference 56.2% of the time against original human-created diagrams, demonstrating significant improvements in professional presentation.

This polishing capability proves particularly valuable for researchers with solid conceptual sketches who lack design expertise or time to execute sophisticated visual treatments.

Real-World Applications and Use Cases

The framework's versatility extends across multiple research domains. In AI and machine learning, it excels at creating model architectures, training pipelines, and system diagrams that clearly communicate complex algorithms. For instance, generating a transformer architecture diagram complete with multi-head attention mechanisms, feed-forward layers, and residual connections becomes a matter of providing text descriptions rather than painstaking manual layout.

Statistical visualizations benefit enormously from the code-based generation mode. Researchers working with experimental results can automatically generate bar charts, line graphs, scatter plots, and other data visualizations that maintain perfect numerical accuracy while adhering to publication standards.

The system also shows promise beyond pure academic contexts. Engineering schematics, industrial diagrams, and technical documentation could all benefit from PaperBanana's ability to understand domain-specific requirements by retrieving relevant reference examples and applying appropriate style constraints.

Technical Infrastructure

PaperBanana builds on Google's advanced AI ecosystem, utilizing Gemini-3-Pro as its primary vision-language model backbone. For image generation, it employs Nano-Banana-Pro and can integrate with other generation models like GPT-Image-1.5. This technical stack positions the framework within Google's broader artificial intelligence infrastructure developments throughout 2025.

The system's reference-driven approach distinguishes it from simpler prompt-based methods. By maintaining a curated database of exemplary diagrams and automatically extracting aesthetic principles from successful publications, PaperBanana learns what makes scientific illustrations effective rather than relying solely on training data.

Limitations and Future Directions

Despite impressive achievements, PaperBanana faces several constraints that researchers acknowledge openly. Content accuracy, particularly regarding fine-grained connectivity details like arrow directions and source-target node relationships, achieved only 45.8% fidelity in evaluations. These micro-level errors require careful human review before publication.

The framework currently outputs raster images rather than vector graphics, limiting downstream editability. Researchers cannot easily modify specific elements without regenerating entire figures. The team suggests several potential solutions: producing 4K resolution images for print quality, developing image processing models for minor adjustments, creating reconstruction pipelines using text recognition and segmentation to extract editable components, or building AI agents capable of operating vector illustration software like Adobe Illustrator.

Another consideration involves the system's reliance on Google's proprietary models, particularly Gemini-3-Pro and Nano-Banana-Pro, which are not publicly accessible. This limits reproducibility and community experimentation, though open-source implementations have begun emerging.

The benchmark's focus on NeurIPS publications, while providing rigorous evaluation, introduces potential bias toward computer science and machine learning aesthetics. Visual conventions differ across disciplines, and the framework's training on AI conference proceedings may not generalize perfectly to biology, chemistry, physics, or social sciences publications.

Implications for Scientific Workflow

PaperBanana represents a significant step toward fully autonomous scientific research pipelines. While AI systems already assist with literature reviews, hypothesis generation, experimental design, and manuscript writing, visual communication has remained a persistent human bottleneck. By automating illustration creation, the framework enables researchers to allocate more time to conceptual work and discovery.

The democratization of high-quality visualization tools particularly benefits researchers without graphic design backgrounds or access to expensive professional software. Junior scientists, independent researchers, and teams at institutions with limited resources can now produce figures matching the visual sophistication of well-funded laboratories.

However, the research team emphasizes that human oversight remains essential. Users should treat these agents as collaborators rather than replacements, maintaining vigilance against potential visual hallucinations or subtle inaccuracies that could compromise scientific integrity. The framework accelerates and enhances the illustration process but does not eliminate the researcher's responsibility for ensuring accuracy.

Integration and Accessibility

The PaperBanana framework has begun seeing adoption through various channels. Open-source implementations have emerged, allowing researchers to experiment with the technology using different backend models. Integration with Model Context Protocol (MCP) servers enables seamless incorporation into AI-powered research workflows.

Several universities and research institutions have reportedly begun testing the system, with researchers at Stanford, MIT, Berkeley, and CMU exploring its capabilities for their publication workflows. The framework's ability to export figures in multiple formats including PNG, SVG, and PDF facilitates integration with standard academic publishing pipelines and LaTeX document preparation.

The Road Ahead

As artificial intelligence continues transforming scientific research, tools like PaperBanana illuminate the path toward increasingly autonomous research workflows. The framework's success in automating a traditionally manual task demonstrates how specialized multi-agent systems can tackle complex creative challenges previously thought to require human judgment and expertise.

Future developments will likely address current limitations, particularly around vector output generation, fine-grained accuracy improvement, and cross-disciplinary aesthetic adaptation. The principles underlying PaperBanana—reference-driven generation, specialized agent orchestration, and iterative refinement through self-critique—could extend to other domains requiring the transformation of technical content into visual communication, from educational materials to business presentations.

## Conclusion

PaperBanana marks a meaningful advance in scientific workflow automation by addressing the often-neglected challenge of academic illustration. Through its innovative five-agent architecture, dual-phase generation process, and emphasis on both aesthetic quality and scientific accuracy, the framework demonstrates that AI systems can successfully navigate the nuanced requirements of publication-ready visual communication.

While limitations remain and human oversight stays essential, PaperBanana's strong performance on the comprehensive PaperBananaBench dataset validates its approach. By freeing researchers from time-consuming manual illustration work, the framework allows greater focus on the core scientific activities of discovery, analysis, and insight generation.

As AI continues evolving from a tool that assists research to a system that performs research, frameworks like PaperBanana represent crucial steps toward that future—not by replacing human scientists, but by handling the auxiliary tasks that distract from scientific creativity and discovery. The result is a potential acceleration of research progress across disciplines, democratization of professional visualization capabilities, and a clearer path toward the vision of truly autonomous scientific investigation.

---

Note: This article is based on the research paper "PaperBanana: Automating Academic Illustration for AI Scientists" by Dawei Zhu (Peking University), Rui Meng, Yale Song, Xiyu Wei, Sujian Li, Tomas Pfister, and Jinsung Yoon (Google Cloud AI Research), published in January 2025.

agentic framework

Related Topics

Google AI Introduces PaperBanana: An Agentic Framework that Automates Publication-Ready Methodology Diagrams and Statistical Plots