Google launches Gemma: new open source AI tool for developers

Google launches Gemma: new open source AI tool for developers

Google launched another AI model only a week after it announced the release of its Gemini models. The new release, Gemma, is part of a family of “lightweight open-source models,” starting with Gemma 2B and Gemma 7B. The large language models are said to be “inspired by Gemini,” and are designed to be used by researchers and developers to innovate safely with AI. 

In a new report, researchers at Gemma and Google’s DeepMind wrote: “We believe the responsible release of LLMs is critical for improving the safety of frontier models and enabling the next wave of LLM innovations.”

The Gemma models reflect the sizes of their parameters. Gemma 7B is a seven-billion-parameter model designed for efficient deployment and development on GPUs and TPUs. In comparison, Gemma 2B is a two-billion-parameter model suited for CPU and on-device applications. “Each size is designed to address different computational constraints, applications, and developer requirements,” the team said.

Alongside the new models, Google said it is introducing a new responsible generative AI toolkit aimed at offering “guidance and essential tools for creating safer AI applications with Gemma,” in addition — it also has a debugging tool.

Google compared the product to other open models, claiming that it outperformed similar-sized open models on 11 of 18 text-based tasks and demonstrated “strong performance across academic benchmarks for language understanding, reasoning, and safety.”

It announced that it would offer integration with JAX, PyTorch, and TensorFlow through native Keras 3.0. Developers can gain access to ready-to-use Colab and Kaggle notebooks, as well as integrations with Hugging Face, MaxText, and Nvidia’s NeMo. Once pre-trained and fine-tuned, these models can be run everywhere.

How Gemma is different to Gemini

In a blog post, Google Cloud AI Vice President Burak Gokturk wrote, “With Vertex AI, builders can reduce operational overhead and focus on creating bespoke versions of Gemma that are optimized for their use case.” Gemma was designed so that these users can test their products in a contained environment, but it warned that “rigorous safety testing” was required before widespread deployment.

Gemma is said to be designed with Google’s AI Principles at the forefront. In an effort to ensure the Gemma pre-trained models are reliable, it stated that automated techniques were employed to filter out certain personal information and other sensitive data from the training sets. Additionally, extensive fine-tuning and reinforcement learning from human feedback (RLHF) aligned the instruction-tuned models with responsible behaviors.

With this in mind, Google is extending free credits to developers and researchers interested in using Gemma. Access is free via Kaggle or Colab, while first-time Google Cloud users are eligible for a $300 credit. Moreover, researchers may apply for grants up to $500,000 for their projects.

Featured image: Google / Canva

Suswati Basu

Freelance journalist

Suswati Basu is a multilingual, award-winning editor and the founder of the intersectional literature channel, How To Be Books. She was shortlisted for the Guardian Mary Stott Prize and longlisted for the Guardian International Development Journalism Award.

With 18 years of experience in the media industry, Suswati has held significant roles such as head of audience and deputy editor for NationalWorld news, digital editor for Channel 4 News
and ITV News. She has also contributed to the Guardian and received training at the BBC As an audience, trends, and SEO specialist, she has participated in panel events alongside Google.

Her career also includes a seven-year tenure at the leading AI company Dataminr, where she led the Europe desk and launched the company’s first employee resource group for disabilities. Before this, Suswati worked as a journalist in China for four years, investigating censorship and the Great Firewall, and acquired proficiency in several languages.

In recent years, Suswati has been nominated for six awards, including the Independent Podcast Awards, International Women’s Podcast Awards, and the Anthem Awards for her literary social affairs show.

Her areas of speciality span a wide range, including technology, Diversity, Equity, and Inclusion (DEI), social politics, mental health, and nonfiction books.

The post “Google launches Gemma: new open source AI tool for developers” by Suswati Basu was published on 02/21/2024 by