0 citations
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
arXiv (Cornell University)2024
Citations Over Time
Gemini Robotics Team, Petko Georgiev, Ving Ian Lei, Ryan Burnell, Libin Bai, Anmol Gulati, Garrett Tanzer, Damien Vincent, Zhufeng Pan, Wang, Shibo, Mariooryad, Soroosh, Yifan Ding, Geng, Xinyang, Fred Alcober, Frostig, Roy, Mark Omernick, Lexi Walker, Paduraru, Cosmin, Christina Sorokin, Tacchetti, Andrea, Colin Gaffney, Samira Daruki, Sercinoglu, Olcan, Zach Gleicher, Juliette Love, Paul Voigtlaender, Rohan Jain, Gabriela Surita, Mohamed, Kareem, Rory Blevins, Junwhan Ahn, Zhu, Tao, Kawintiranon, Kornraphop, Orhan Fırat, Gu, Yiming, Yujing Zhang, Rahtz, Matthew, Faruqui, Manaal, Natalie A. Clay, Justin Gilmer, Co-Reyes, JD, Ivo Penchev, Rui Zhu, Nobuyuki Morioka, Kevin Hui, Krishna Haridasan, Víctor Campos, Mahdieh, Mahdis, Guo, Mandy, Samer Hassan, Kilgour, Kevin, Arpi Vezer, Cheng, Heng-Tze, Raoul de Liedekerke, Goyal, Siddharth, Paul Barham, Strouse, DJ, Seb Noury, Jonas Adler, Mukund Sundararajan, Sharad Vikram, Lepikhin, Dmitry, Michela Paganini, Xavier García, Fan Yang, Valter, Dasha, Maja Trębacz, Kiran Vodrahalli, Chulayuth Asawaroengchai, Roman Ring, Kalb, Norbert, Livio Baldini Soares, Siddhartha Brahma, David F. Steiner, Tianhe Yu, Fabian Mentzer, Antoine He, Lucas Gonzalez, Bibo Xu, Raphaël Lopez Kaufman, Laurent El Shafey, Junhyuk Oh, Tom Hennigan, George van den Driessche, Seth Odoom, Mario Lučić, Becca Roelofs, Lall, Sid, Amit Marathe, Chan, Betty, Santiago Ontañón, Luheng He, Denis Teplyashin, Lai, Jonathan, Phil Crone, Bogdan Damoc, Ho, Lewis, Sebastian Riedel, Karel Lenc, Chih‐Kuan Yeh, Aakanksha Chowdhery, Yang Xu, Mehran Kazemi, Amid, Ehsan, Anastasia Petrushkina, Kevin Swersky, Ali Khodaei, Chen, Gowoon, Chris Larkin, Mário Pinto, Yan, Geng, Adrià Puigdomènech Badia, Piyush Patil, Steven Hansen, Orr, Dave, Sébastien M. R. Arnold, Jordan Grimstad, Andrew M. Dai, Sholto Douglas, Rishika Sinha, Yadav, Vikas, Xi Chen, Elena Gribovskaya, Jacob Austin, Jeffrey Zhao, Patel, Kaushal, Paul Komarek, Sophia Austin, Sebastian Borgeaud, Friso, Linda, Goyal, Abhimanyu, Ben Caine, Kris Cao, Da-Woon Chung, Matthew S. Lamm, Gabe Barth-Maron, Thais Kagohara, Kate Olszewska, Mia Chen, Kaushik Shivakumar, Agarwal, Rishabh, Godhia, Harshal, Ravi Rajwar, Javier Snaider, Xerxes Dotiwalla, Liu, Yuan, Barua, Aditya, Victor Ungureanu, Zhang, Yuan, Batsaikhan, Bat-Orgil, Mateo Wirth, James Qin, Ivo Danihelka, Doshi, Tulsee, Martin J. Chadwick, Jilin Chen, Jain, Sanil, Le, Quoc, Kar, Arjun, Gurumurthy, Madhu, Cheng Li, Ruoxin Sang, Fangyu Liu, Lamprou, Lampros, Munoz, Rich, Lintz, Nathan, Harsh Mehta, Howard, Heidi, Malcolm Reynolds, Lora Aroyo, Wang, Quan, Lorenzo Blanco, Albin Cassirer, Jordan Griffith, Das, Dipanjan, Stephan Lee, Jakub Sygnowski, Fisher, Zach, James Besley, Richard W. Powell, Zafarali Ahmed, Paulus, Dominik, David Reitter, Borsos, Zalan, Rishabh Joshi, Aedan Pope, Steven C. Hand, Vittorio Selo, Jain, Vihan, Nikhil Sethi, Megha Goel, Makino, Takaki, R. May, Zhen Yang, Johan Schalkwyk, Christina Butterfield, Anja Hauth, Alex Goldin, Will Hawkins, Evan Senter, Sergey Brin, Oliver Woodman, Marvin Ritter, Eric Noland, Minh Giang, Vijay Bolina, Lisa Lee, Tim Blyth, Ian D.R. Mackinnon, Machel Reid, Sarvana, Obaid, David Silver, Alexander Chen, Lily Wang, Loren Maggiore, Oscar Chang, Nithya Attaluri, Gregory Thornton, Chung‐Cheng Chiu, Oskar Bunyan, Nir Levine, Timothy S. Chung, Evgenii Eltyshev, Xiance Si, Timothy Lillicrap, Brady, Demetra, Aggarwal, Vaibhav, Boxi Wú, Yuanzhong Xu, Ross McIlroy, Kartikeya Badola, Paramjit Sandhu, Érica Rodrigues Moreira, Wojciech Stokowiec, Ross Hemsley, Dong Li, Alex Tudor, Pranav Shyam, Rahimtoroghi, Elahe, Salem Haykal, Pablo Sprechmann, Zhou, Xiang, Diana Mincu, Yujia Li, Ravi Addanki, Krishna, Kalpesh, Wu, Xiao, Alexandre Fréchette, Eyal, Matan, Dafoe, Allan, Dave Lacey, Whang, Jay, Thi Avrahami, Zhang, Ye, Emanuel Taropa, Hanzhao Lin, Daniel Toyama, Eliza Rutherford, Sano, Motoki, Choe, HyunJeong, Alex Tomala, Safranek-Shrader, Chalence, Nora Kassner, Mantas Pajarskas, M J Harvey, Sean Sechrist, Meire Fortunato, Chen Lyu, Gamaleldin F. Elsayed, Kuang, Chenkai, James Lottes, Chu, Eric, Jia, Chao, Chen, Chih-Wei, Peter Humphreys, Kate Baumli, Tao, Connie, Rajkumar Samuel, Cícero Nogueira dos Santos, Anders Andreassen, Nemanja Rakićević, Grewe, Dominik, Aviral Kumar, Stephanie Winkler, Jonathan Caton, Andrew Brock, Sid Dalmia, Hannah Sheahan, Iain Barr, Yingjie Miao, Paul Natsev, Jacob Devlin, Behbahani, Feryal, Prost, Flavien, Yanhua Sun, Myaskovsky, Artiom, Thanumalayan Sankaranarayana Pillai, Dan Hurt, Angeliki Lazaridou, Xi Xiong, Ce Zheng, Fabio Pardo, Li, Xiaowei, Dan Horgan, Joe Stanton, Ambar, Moran, Fei Xia, Alejandro Lince, Mingqiu Wang, Basil Mustafa, Albert Webson, Hyo Jong Lee, Rohan Anil, Martin Wicke, Dozat, Timothy, Sinha, Abhishek, Enrique Piqueras, Elahe Dabir, Upadhyay, Shyam, Anudhyan Boral, Lisa Anne Hendricks, Fry, Corey, Josip Djolonga, Su, Yi, Walker, Jake, Jane Labanowski, Huang, Ronny, Vedant Misra, Jeremy J.W. Chen, Skerry-Ryan, RJ, Singh, Avi, Rijhwani, Shruti, Dian Yu, Castro-Ros, Alex, Beer Changpinyo, Romina Datta, Bagri, Sumit, Arnar Mar Hrafnkelsson, Marcello Maggioni, Zheng, Daniel, Sulsky, Yury, Shaobo Hou, Tom Le Paine, Antoine Yang, Riesa, Jason, Dominika Rogozińska, Marcus, Dror, Dalia El Badawy, Qiao Zhang, Wang, Luyu, Helen Miller, Greer, Jeremy, Sjos, Lars Lowe, Azade Nova, Heiga Zen, Rahma Chaabouni, Mihaela Roşca, Jiepu Jiang, Charlie Chen, Ruibo Liu, Tara N. Sainath, Maxim Krikun, Alex Polozov, Jean-Baptiste Lespiau, Josh Newlan, Zeyncep Cankara, Kwak, Soo, Yunhan Xu, Phil Chen, Coenen, Andy, Clemens Meyer, Katerina Tsihlas, Ada W. W., Gottweis, Juraj, Xing, Jinwei, Chenjie Gu, Miao, Jin, Christian Frank, Cankara, Zeynep, Sanjay Ganapathy, Ishita Dasgupta, Hughes-Fitt, Steph, Chen, Heng, David L. Reid, Keran Rong, Fan, Hongmin, Joost van Amersfoort, Zhuang, Vincent, Cohen, Aaron, Gu, Shixiang Shane, Mohananey, Anhad, Anastasija Ilić, Taylor Tobin, Wieting, John, Anna Bortsova, Phoebe Thacker, Wang, Emma, Caveness, Emily, Justin Chiu, Eren Sezener, Kaskasoli, Alex, Baker, Steven, Katie Millican, Mohamed Elhawaty, Aisopos, Kostas, Carl Lebsack, Nathan Byrd, Dai, Hanjun, Wenhao Jia, Matthew Wiethoff, Elnaz Davoodi, Weston, Albert, Lakshman Yagati, Arun Ahuja, Isabel Gao, Pundak, Golan, Zhang, Susan, Michael Azzam, Sim, Khe Chai, Sergi Caelles, James Keeling, Abhanshu Sharma, Andy Swing, YaGuang Li, Liu, Chenxi, Carrie Grimes Bostock, Yamini Bansal, Zachary Nado, Ankesh Anand, Josh Lipschultz, Abhijit Karmarkar, Lev Proleev, Ittycheriah, Abe, Soheil Hassas Yeganeh, Polovets, George, Faust, Aleksandra, Sun, Jiao, Alban Rrustemi, Li, Pen, Rakesh Shivanna, Jeremiah Liu, Chris Welty, Lebron, Federico, Anirudh Baddepudi, Krause, Sebastian, Emilio Parisotto, Radu Soricut, Xu, Zheng, Dawn Bloxwich, Melvin Johnson, Behnam Neyshabur, Justin Mao-Jones, Renshen Wang, Vinay Ramasesh, Zaheer Abbas, Arthur Guez, Constant Segal, Duc Dung Nguyen, James Svensson, Le Hou, Sarah York, Milan, Kieran, Sophie Bridgers, Wiktor Gworek, Marco Tagliasacchi, James Lee-Thorp, Michael B. Chang, Alexey Guseynov, Ale Jakse Hartman, Kwong, Michael, Rongxuan Zhao, Sheleem Kashem, Cole, Elizabeth, Antoine Miech, Richard Tanburn, Phuong, Mary, Filip Pavetic, Sébastien Cevey, Ramona Comanescu, Richard Ives, Yang, Sherry, Du, Cosmo, Bo Li, Zhang, Zizhao, Mariko Iinuma, Clara Huiyi Hu, Aurko Roy, Bijwadia, Shaan, Zhenkai Zhu, Danilo Martins, Saputro, Rachel, Anita Gergely, Zheng, Steven, Dawei Jia, Ioannis Antonoglou, Sadovsky, Adam, Shane Gu, Bi, Yingying, Alek Andreev, Sina Samangooei, Mina Khan, Tomáš Kočiský, Angelos Filos, Kumar, Chintu, Colton Bishop, Yu, Adams, Sarah Hodkinson, Sid Mittal, Shah, Premal, Moufarek, Alexandre, Yong Cheng, Bloniarz, Adam, Jaehoon Lee, Pedram Pejman, Paul Michel, Stephen Spencer, Vladimir Feinberg, Xuehan Xiong, Nikolay Savinov, Charlotte G. Smith, Siamak Shakeri, Tran, Dustin, Chesus, Mary, Bernd Bohnet, George Tucker, Tamara von Glehn, Carrie Muir, Mao, Yiran, Kazawa, Hideto, Ambrose Slone, Kedar Soparkar, Disha Shrivastava, James Cobon-Kerr, Michael Sharman, Pavagadhi, Jay, Carlos García Araya, Misiunas, Karolis, Nimesh Ghelani, Michael Laskin, David C. Barker, Li, Qiujia, Anton Briukhov, Neil Houlsby, Mia Glaese, Balaji Lakshminarayanan, Nathan Schucher, Yunhao Tang, Eli Collins, Hyeontaek Lim, Fangxiaoyu Feng, Adrià Recasens, Guangda Lai, Alberto Magni, Nicola De Cao, Aditya Siddhant, Zoe C. Ashwood, Orbay, Jordi, Mostafa Dehghani, J. William Brennan, He, Yifan, Kelvin Xu, Gao, Yang, Saroufim, Carl, James Molloy, Wu, Xinyi, Arnold, Seb, Solomon Chang, Julian Schrittwieser, Elena Buchatskaya, Soroush Radpour, Martin Poláček, Skye Giordano, Ankur Bapna, Simon Tokumine, Vincent J. Hellendoorn, Thibault Sottiaux, Cogan, Sarah, Severyn, Aliaksei, Mohammad Saleh, Shantanu Thakoor, Shefey, Laurent, Siyuan Qiao, Meenu Gaba, Shuo-Yiin Chang, Craig Swanson, Biao Zhang, Benjamin Lee, Paul K. Rubenstein, Song, Gan, Kwiatkowski, Tom, Anna Koop, Kannan, Ajay, Kao, David, Parker Schuh, Axel Stjerngren, Ghiasi, Golnaz, Gibson, Gena, Luke Vilnis, Yuan, Ye, Ferreira, Felipe Tiengo, Aishwarya Kamath, Klimenko, Ted, Ken Franko, Kefan Xiao, Bhattacharya, Indro, Miteyan Patel, Wang, Rui, Alex Morris, Robin Strudel, Vivek Sharma, Peter Choy, Sayed Hadi Hashemi, Jessica Landon, Finkelstein, Mara, Priya Jhakra, Justin Frye, Megan Barnes, Matthew Mauger, Daun, Dennis, Khuslen Baatarsukh, Matthew Tung, Farhan, Wael, Henryk Michalewski, Fabio Viola, Félix de Chaumont Quitry, Charline Le Lan, Tom Hudson, Qingze Wang, Fischer, Felix, Ivy Zheng, Elspeth White, Dragan, Anca, Jean-baptiste Alayrac, Ni, Eric, Alexander Pritzel, Adam Iwanicki, Michael Isard, Anna Bulanova, Lukáš Žilka, Ethan Dyer, Devendra Singh Sachan, Srivatsan Srinivasan, Muckenhirn, Hannah, Cai, Honglong, Amol Mandhane, Mukarram Tariq, Jack W. Rae, Wang, Gary, Kareem Ayoub, Nicholas FitzGerald, Yao Zhao, Han, Woohyun, Alberti, Chris, Garrette, Dan, Kashyap Krishnakumar, Mai Giménez, Anselm Levskaya, Daniel Sohn, Matak, Josip, Iturrate, Inaki, Michael B. Chang, Xiang, Jackie, Cao, Yuan, Ranka, Nishant, Geoff Brown, Hutter, Adrian, Mirrokni, Vahab, Nanxin Chen, Yao, Kaisheng, Egyed, Zoltan, Galilee, Francois, Tyler Liechty, Praveen Kallakuri, Evan M. Palmer, Sanjay Ghemawat, Jasmine Liu, Tao, David, Chloe Thornton, Green, Tim, Mimi Jasarevic, Lin, Sharon, Victor Cotruta, Tan, Yi-Xuan, Noah Fiedel, Hongkun Yu, Chi, Ed, Alexander Neitz, Heitkaemper, Jens, Sinha, Anu, Zhou, Denny, Yi Sun, Charbel Kaed, Brice Hulse, Mishra, Swaroop, Maria Georgaki, Kudugunta, Sneha, Clément Farabet, Shafran, Izhak, Daniel Vlasic, Tsitsulin, Anton, R. Ananthanarayanan, Carin, Alen, Guolong Su, Sun, Pei, V, Shashank, Gabriel Carvajal, Josef M. Broder, Comsa, Iulia, Alena Repina, Wong, William, Chen, Warren Weilun, Peter Hawkins, Filonov, Egor, Lucia Loher, Hirnschall, Christoph, Wang, Weiyi, Ye, Jingchen, Burns, Andrea, Hardie Cate, Diana Gage Wright, Piccinini, Federico, Zhang, Lei, Chu‐Cheng Lin, Gog, Ionel, Yana Kulizhskaya, Ashwin Sreevatsa, Song, Shuang, Luis C. Cobo, Iyer, Anand, Chetan Tekur, Garrido, Guillermo, Zhuyun Xiao, Rupert Kemp, Zheng, Huaixiu Steven, Hui Li, Ananth Agarwal, Christel Ngani, Goshvadi, Kati, Rebeca Santamaría-Fernández, Fica, Wojciech, Chen, Xinyun, Gorgolewski, Chris, Sun, Sean, Roopal Garg, Xinyu Ye, Eslami, S. M. Ali, Nan Hua, Simon, Jon, Joshi, Pratik, Yelin Kim, Ian Tenney, Potluri, Sahitya, Thiet, Lam Nguyen, Quan Yuan, Luisier, Florian, Chronopoulou, Alexandra, Salvatore Scellato, P. Srinivasan, Chen, Minmin, Vinod Koverkathu, Dalibard, Valentin, Xu, Yaming, Brennan Saeta, Anderson, Keith, Thibault Sellam, Nick Fernando, Fantine Huot, Jung, Junehyuk, Mani Varadarajan, Michael Quinn, Raul, Amit, Maigo Le, Habalov, Ruslan, Clark, Jon, Komal Jalan, Bullard, Kalesha, Achintya Singhal, Luong, Thang, Wang, Boyu, Rajayogam, Sujeevan, Eisenschlos, Julian, Johnson Jia, Daniel Finchelstein, Alex Yakubovich, Balle, Daniel, Michael Fink, Agarwal, Sameer, Jing Li, Dvijotham, Dj, Pal, Shalini, Kang, Kai, Jaclyn Konzelmann, Jennifer Beattie, Olivier Dousse, Diane Wu, Remi Crocker, Chen Elkind, Jonnalagadda, Siddhartha Reddy, Lee, Jong, Dan Holtmann-Rice, Krystal Kallarackal, Rosanne Liu, Denis Vnukov, Neera Vats, Invernizzi, Luca, Mohsen A. Jafari, Zhou, Huanjie, Lilly Taylor, J. Prendki, Marcus Wu, Eccles, Tom, Tianqi Liu, Kopparapu, Kavya, Beaufays, Francoise, Christof Angermueller, Marzoca, Andreea, Shourya Sarcar, Dib, Hilal, Jeff Stanway, Perbet, Frank, Nejc Trdin, Rachel Sterneck, Andrey Khorlin, Dinghua Li, Xihui Wu, Sonam Goenka, David Madras, Goldshtein, Sasha, Willi Gierke, Zhou, Tong, Yaxin Liu, Yannie Liang, Anaïs White, Yunjie Li, Singh, Shreya, Bahargam, Sanaz, Mark Epstein, Sujoy Basu, Li Lao, Ozturel, Adnan, Carl Crous, Zhai, Alex, Lu Han, Zora Tung, Gaur, Neeraj, Alanna Walton, Lucas Dixon, Ming Zhang, Amir Globerson, Grant Uy, Andrew Bolt, Wiles, Olivia, Milad Nasr, Shumailov, Ilia, M. Selvi, Piccinno, Francesco, Ricardo Aguilar, Sara McCarthy, Misha Khalman, Mrinal Shukla, Galic, Vlado, John H. Carpenter, Villela, Kevin, Haibin Zhang, Harry W. Richardson, Martens, James, Bosnjak, Matko, Shreyas Rammohan Belle, Jeff Seibert, Mahmoud Alnahlawi, McWilliams, Brian, Sankalp Singh, Annie Louis, Ding, Wen, Popovici, Dan, Simicich, Lenin, Laura Knight, Mehta, Pulkit, Nishesh Kumar Gupta, Shi, Chongyang, Saaber Fatehi, Mitrovic, Jovana, Grills, Alex, Pagadora, Joseph, Munkhdalai, Tsendsuren, Dessie Petrova, Eisenbud, Danielle, Zhishuai Zhang, Damion Yates, Mittal, Bhavishya, Nilesh Tripuraneni, Assael, Yannis, Brovelli, Thomas, Jain, Prateek, Velimirovic, Mihajlo, Akbulut, Canfer, Mu, Jiaqi, Macherey, Wolfgang, Ravin Kumar, Jun Xu, Haroon Qureshi, Comanici, Gheorghe, Jeremy Wiesner, Gong, Zhitao, Ruddock, Anton, Bauer, Matthias, Felt, Nick, GP, Anirudh, Arnab, Anurag, Zelle, Dustin, Rothfuss, Jonas, Bill Rosgen, Ashish Shenoy, Seybold, Bryan, Li, Xinjian, Mudigonda, Jayaram, Erdogan, Goker, Jiawei Xia, Jiřı Šimša, Michi, Andrea, Yao, Yi, Christopher Yew, Kan, Steven, Caswell, Isaac, Carey Radebaugh, André Elisseeff, Pedro L. Valenzuela, McKinney, Kay, Kim Paterson, Albert Cui, Eri Latorre-Chimoto, Solomon Kim, Zeng, William, Ken Durden, Priya Ponnapalli, Sosea, Tiberiu, Christopher A. Choquette-Choo, James Manyika, Brona Robenek, Harsha Vashisht, Pereira, Sebastien, H.Y. Lam, Velic, Marko, Denese Owusu-Afriyie, Katherine Lee, Tolga Bolukbasi, Alicia Parrish, Shawn Lu, Jane Park, Balaji Venkatraman, Alice Talbert, Rosique, Lambert, Yuchung Cheng, Sozanschi, Andrei, Adam Paszke, Praveen Kumar, Jessica Austin, Lu Li, Salama, Khalid, Perz, Bartek, Wooyeol Kim, Nandita Dukkipati, Baryshnikov, Anthony, Kaplanis, Christos, Sheng, XiangHai, Chervonyi, Yuri, Çağlar Ünlü, Diego de Las Casas, Harry Askham, Tunyasuvunakool, Kathryn, Gimeno, Felix, Siim Põder, Kwak, Chester, Matt Miecnikowski, Mirrokni, Vahab, Alek Dimitriev, Parisi, Aaron, Dangyi Liu, Tomy Tsai, Shevlane, Toby, Kouridi, Christina, Drew Garmon, Adrian Goedeckemeyer, Adam J. Brown, Anitha Vijayakumar, Ali Elqursh, Sadegh Jazayeri, Jin Huang, Carthy, Sara Mc, Jay Hoover, Lucy Kim, Sandeep Kumar, Chen, Wei, Biles, Courtney, Bingham, Garrett, Rosen, Evan, Wang, Lisa, Tan, Qijun, David Engel, Pongetti, Francesco, Dario de Cesare, Hwang, Dongseong, Lily Yu, Pullman, Jennifer, Narayanan, Srini, Kyle Levin, Gopal, Siddharth, Megan Li, Asaf Aharoni, Trinh, Trieu, Lo, Jessica, Norman Casagrande, Vij, Roopali, Matthey, Loic, Ramadhana Bramandia, Matthews, Austin, Carey, CJ, Matthew Johnson, Goranova, Kremena, Shah, Rohin, Shereen Ashraf, Kingshuk Dasgupta, Larsen, Rasmus, Yicheng Wang, Vuyyuru, Manish Reddy, Jiang, Chong, Ijazi, Joana, Osawa, Kazuki, Smith, Celine, Boppana, Ramya Sree, Bilal, Taylan, Koizumi, Yuma, Ying Xu, Altun, Yasemin, Nir Shabat, Ben Bariach, Alex Korchemniy, Kiam Choo, Ronneberger, Olaf, Chimezie Iwuanyanwu, Zhao, Shubin, David Soergel, Hsieh, Cho-Jui, Irene Cai, Shariq Iqbal, Sundermeyer, Martin, Zhe Chen, Bursztein, Elie, Malaviya, Chaitanya, Biadsy, Fadi, Prakash Shroff, Dhillon, Inderjit, Latkar, Tejasi, Chris Dyer, Hannah Forbes, Nicosia, Massimo, V. A. Nikolaev, Somer Greene, Мarin Georgiev, Pidong Wang, Nina Martin, Sedghi, Hanie, John H. Zhang, Praseem Banzal, Doug Fritz, Rao, Vikram, Wang, Xuezhi, Jiageng Zhang, Patraucean, Viorica, Dayou Du, Mordatch, Igor, Jurin, Ivan, Liu, Lewis, Dubey, Ayush, AnandC. S. Mohan, Nowakowski, Janek, Ion, Vlad-Doru, Nan Wei, Reiko Tojo, Maria Abi Raad, Hudson, Drew A., Keshava, Vaishakh, Agrawal, Shubham, Kevin Ramirez, Wu, Zhichun, Nguyen, Hoang, Liu, Ji, Sewak, Madhavi, Petrini, Bryce, Donghyun Choi, Ivan Philips, Wang, Ziyue, Bica, Ioana, Ankush Garg, Jarek Wilkiewicz, Agrawal, Priyanka, Li, Xiaowei, Guo, Danhao, Xue, Emily, Shaik, Naseer, Leach, Andrew, Khan, Sadh MNM, Wiesinger, Julia, Jerome, Sammy, Abhishek Chakladar, Alek Wenjiao Wang, Tina Ornduff, Abu, Folake, Alireza Ghaffarkhah, Wainwright, Marcus, Cortes, Mario, Frederick Liu, Maynez, Joshua, Terzis, Andreas, Samangouei, Pouya, Mansour, Riham, Kępa, Tomasz, Aubet, François-Xavier, Algymr, Anton, Banica, Dan, Weisz, Agoston, Orban, Andras, Senges, Alexandre, Andrejczuk, Ewa, Geller, Mark, Santo, Niccolo Dal, Anklin, Valentin, Merey, Majd Al, Baeuml, Martin, Strohman, Trevor, Bai, Junwen, Slav Petrov, Yonghui Wu, Demis Hassabis, Koray Kavukcuoglu, Dean, Jeff, Oriol Vinyals
Abstract
In this report, we introduce the Gemini 1.5 family of models, representing the next generation of highly compute-efficient multimodal models capable of recalling and reasoning over fine-grained information from millions of tokens of context, including multiple long documents and hours of video and audio. The family includes two new models: (1) an updated Gemini 1.5 Pro, which exceeds the February version on the great majority of capabilities and benchmarks; (2) Gemini 1.5 Flash, a more lightweight variant designed for efficiency with minimal regression in quality. Gemini 1.5 models achieve near-perfect recall on long-context retrieval tasks across modalities, improve the state-of-the-art in long-document QA, long-video QA and long-context ASR, and match or surpass Gemini 1.0 Ultra's state-of-the-art performance across a broad set of benchmarks. Studying the limits of Gemini 1.5's long-context ability, we find continued improvement in next-token prediction and near-perfect retrieval (>99%) up to at least 10M tokens, a generational leap over existing models such as Claude 3.0 (200k) and GPT-4 Turbo (128k). Finally, we highlight real-world use cases, such as Gemini 1.5 collaborating with professionals on completing their tasks achieving 26 to 75% time savings across 10 different job categories, as well as surprising new capabilities of large language models at the frontier; when given a grammar manual for Kalamang, a language with fewer than 200 speakers worldwide, the model learns to translate English to Kalamang at a similar level to a person who learned from the same content.
Related Papers
- → PACWON: A parallelizing compiler for workstations on a network(1998)
- Study and Two Types of Typical Usage of DataGrid Web Server Control(2005)
- Achieving Parameter of DBSCAN Based on Datagrid(2010)
- Using DataGrid Control to Realize DataBase of Querying in VB6.0(2000)
- Susquehanna Chorale Spring Concert "Roots and Wings"(2017)