Neural Networks and Deep Learning Lab

MIPT’s Neural Networks and Deep Learning Lab was established in 2015 to carry out fundamental and applied research into neural systems and deep learning mechanisms, aimed at creating artificial intelligence. This work involves the development of new algorithms capable of identifying a sequence of actions that will lead to the solution of a problem in an unknown environment without any supervision. Achieving this will make AI systems significantly more autonomous, expanding the range of their possible applications.

Laboratory webpage: deeppavlov.ai

The Neural Networks and Deep Learning Laboratory at MIPT conducts research in the field of deep neural network architectures for working with text in natural language, namely: creating algorithms capable of finding sequences of actions without a "teacher" to solve a task in an unknown environment. Since June 2017, the main activity of the laboratory is implementation of the DeepPavlov project. DeepPavlov is an open source library for text analysis and creation of dialog systems. The project is aimed at developing conversational neural network machine intelligence that can carry on a meaningful dialog with a person and achieve the goal set in the dialog. In the course of this work, the technological barrier in the field of machine intelligence algorithms will be overcome by consolidating knowledge about the mechanisms of the brain activity and the modern theory of deep machine learning.

The laboratory staff includes about 30 researchers and engineers, including 3 candidates of science, 7 postgraduates, and 2 students. The laboratory staff has published more than 50 scientific papers. The laboratory's hardware consists of a specialized computer for calculating neural network models (31st place in the Russian supercomputer rating), a mini cluster, and workstations with a total capacity of 125 GPUs.

Since 2016, every semester the laboratory conducts courses on "Applying Deep Learning of Neural Networks to Natural Language Processing Tasks" and "Reinforcement Learning". In the 2017–2018 academic year, the laboratory's employees were involved in the Machine Learning School for High School Students. In July 2018, the first CISS School on using the DeepPavlov library was held. In July 2019, the first international CISS 2 NLP School was held at Lowell University (USA).

The Neural Networks and Deep Learning Laboratory at MIPT held six international week-long scientific hackathon schools, which were attended by about 1000 people, and 40 leading researchers in the field of machine intelligence (Google Brain, Google DeepMind, openAI, Facebook AI Research, University of Oxford, New York University, Carnegie Mellon University, Stanford University, among others) gave public lectures, which were attended by more than 500 people. The lectures can be found on the laboratory's YouTube channel. This allowed us to form a pool of scientists and developers to implement the project and establish academic links with leading research centers in the field of artificial intelligence.

The laboratory of neural systems and deep learning also has industry recognition. In November 2015, it received a grant of $18,000 to use IBM cloud resources for research, and in January 2016 it received the status of NVIDIA GPU Research Center. In July 2016, the Lab won a Facebook grant in the form of GPU servers (one of 14 labs from 8 countries). In July 2019, a team of postgraduates from the laboratory made it to the final of the Amazon competition — Alexa Prize Socialbot Challenge. In 2019, the DeepPavlov project won the "Powered by TF Challenge" competition from Google for the best machine learning project that uses the TensorFlow library.

 

--
You can learn more about our project DeepPavlov and our team in Alexa Prize SocialBot Challenge 3

We are at Facebook, Twitter, YouTube

Problem? Ask a Question or try our Demo

We write for the popular IT and ML blogs and have our own blog on Medium.


Mikhail Burtsev

Head of Neural Networks and Deep Learning Lab

Education

Ph.D., Computer Simulation and Numerical Methods

                  Keldysh Institute of Applied Mathematics of Russian Academy of Sciences    (2005), Moscow, Russia

M.S., Semiconductor Engineering,

                  Moscow Power Engineering Institute (2000), Moscow, Russia

B.S., Semiconductor Engineering,

                  Moscow Power Engineering Institute (1998), Moscow, Russia

Professional experience

Head of iPavlov project 

https://deepmipt.github.io/DeepPavlov/

School of Applied Mathematics and Computer Science,

MIPT, Dolgoprudny, Russia 

 

Head of the of the Neural Nets and Deep Learning lab

https://github.com/deepmipt

School of Applied Mathematics and Computer Science,

MIPT, Dolgoprudny, Russia 

 

Head of the of the Department of Neuroscience

Department of Neuroscience,

Kurchatov NBIC Centre, Moscow, Russia 

 

Head of the Neuromorphic Cognitive Systems lab

Department of Neuroscience,

Kurchatov NBIC Centre, Moscow, Russia 

 

Senior Research Scientist

Department of systems development,

P.K.Anokhin Institute of Normal Physiology of RAMS, Moscow, Russia

 

Research Scientist

Department of non-linear dynamics,

Keldysh Institute of Applied Mathematics of RAS, Moscow, Russia

 

Senior Academic Visitor

Wolfson College, University of Cambridge, Cambridge, UK

Host: Prof. Patrick Bateson

 

 

Academic Interests

NLP; Deep learning; Neurocognitive architectures; Neuroevolution


voice: +7 (903) 5614149

email: burtcev.ms@mipt.ru

web: http://linkedin.com/in/mikhail-burtsev-85a47b9  

Vasily Konovalov

Researcher, MSc in Computer Science

Education
B.Sc. in Computer Science, Transbaikal State University
M.Sc. in Computer Science, Bar - Ilan University
Professional experience
Machine Learning and Natural Language Processing Researcher
Developer and DevOps Team Leader
Senior Programmer and Security Specialist
Academic Interests
Dialogue Systems
Natural Language Processing
Deep Learning
Machine Learning

email: vaskoncv@gmail.com

Artyom Sorokin

Researcher

Education
Saint Petersburg Academic University of the Russian Academy of Sciences, MS in Software Engineering (2014)
Professional experience
Machine learning, computer vision, reinforced learning, development of code analysis tools, mathematical modeling of biological neural systems

Awards: 
2nd place in the international hackathon DeepHack.RL (2017), team 5Vision
7th place and "category prize" in the international competition in Deep Reinforcement Learning: Animal AI Olympics (2019), team DeepFox
Academic Interests
Deep Reinforcement Learning, Continual and Lifelong Learning, Biologically plausible learning models

email: griver29@gmail.com

Alexandr Dmitrievskiy

Engineer

Education
Master, Department of General and Applied Physics, MIPT
Professional experience
Design and development of systems for decision support, data analysis and signal processing
Academic Interests
Data Analysis, Natural Language Processing, Adaptive Systems

email: acrip.tis@gmail.com

Fedor Ignatov

Engineer

Education
Bachelor of Applied Mathematics and Physics, MIPT
Professional experience
Gas modeling, EMG, ECG, EEG processing, computer vision, UAV SLAM
Academic Interests
Machine Learning, Robotics

email: fedor.ignatov@phystech.edu

Anastasia Kravtsova

Researcher

Education
2014 -- 2018: Lomonosov Moscow State University, BA in Fundamental and Applied Linguistics

2018 -- present: National Research University Higher School of Economics, MSc in Computational Linguistics
Professional experience
2018-09 -- 2019-04: Samsung R&D Institute Russia, Junior Engineer at Bixby voice assistant localization to Russian project


Awards:
2016: Humboldt University of Berlin, exchange program scholarship in the field of Linguistics
Academic Interests
Natural Language Processing, Data Engineering

email: anastasia_kravtsova@bk.ru

Oleg Serikov

Researcher

Education
B.A. System Programming at Moscow Aviation Institute (National Research University),
Faculty of IT and Applied Mathematics. 2014 - 2018

M.A. Computational Linguistics at Higher School of Economics,
School of Linguistics, Faculty of Humanities. 2018 - 2020 (expected)
Professional experience
2016-2020 backend developer, Delta Solutions LLC; 
2018 google summer of code;
2018 developer at "Mechanium"
2020 teaching, faculty of IT, HSE

email: srkvoa@gmail.com

Elena Ermakova

Researcher

Education
2014 - 2018 - BSc Mathematics and Physics (DCAM MIPT)
2018 - present - MSc Mathematics and Physics (DCAM MIPT)
Professional experience
2018 - present - Neural Networks and Deep Learning Lab, MIPT
Academic Interests
Natural language processing, ranking models

email: yelena.ermakova@phystech.edu

Dilyara Baymurzina

Researcher

Education
2011-2015 - Bachelor's degree at DCAM MIPT.
2015-2017 - Master's degree at DCAM MIPT.
2015-2017 - Master's degree of IT at Skoltech.
Professional experience
July 2017 - ... - Neural networks and deep learning lab at MIPT
Academic Interests
Neural algorithms, neural evolutionary algorithms

email: dilyara.rimovna@gmail.com

Yurii Kuratov

Researcher

Education
2016 DIHT MIPT, Master Degree. Currently, he is a PhD student at DIHT MIPT.
Professional experience
2014 - 2017, developer at ABBYY, GICR (The General Internet-Corpus of Russian)
2017 - researcher at Neural Systems and Deep Learning Lab

Awards:
Winner of NIPS Conversational Intelligence Challenge 2017 (team bot#1337)
Academic Interests
Neural Systems and Deep Learning, Differentiable Programming, Natural Language Processing, Dialog System

email: yurii.kuratov@phystech.edu

Leonid Pugachev

Researcher

Education
In 2011 received a master's degree from the Moscow Institute of Physics and Technology
In 2015 awarded a degree of candidate of physical and mathematical sciences at the Joint Institute for High Temperatures RAS
Professional experience
2011-2015: Junior Researcher, Joint Institute for High Temperatures RAS
2014-2015: Assistant, Chair of Computational Mathematics, Moscow Institute of Physics and Technology
2015-2016: Researcher, Chair of General Physics, Moscow Institute of Physics and Technology
2015-2017: Researcher, Joint Institute for High Temperatures RAS
Since 2017 Researcher, Laboratory of Neural Systems and Deep Learning, Moscow Institute of Physics and Technology
Academic Interests
Machine learning, quantum information theory, plasma physics

email: puleon@mail.ru

Daniel Kornev

Engineer

Education
MS in Computer Science, 2008. Thesis: "Exploring Opportunities for Developing Context-Aware Systems depending on Changes in the Information Environment".
Professional experience
Joined Microsoft Student Partner Program with focus on WinFS and object-relational technologies in 2005. Jumpstarted and led .NET Community in my institute, MIEM.
Joined Microsoft in 2007 as a Developer Evangelist in Developer & Platform Evangelism team. Focus - databases and object-relational technologies.
Moved to Program Manager role in 2008, and led Russian MSDN website. In two years got 10x audience growth. Started Russian MSDN blogs (including local daily developer news, official Russian mirror of Engineering Windows 7 blog, as well as local DPE team), Russian MSDN Forums, as well as several dev centers that aggregated all content for developers to build Windows and Web apps. 
In addition to primary job responsibilities, together with NTO Officer of Microsoft Russia led context-aware computing research group that worked together with Microsoft Technologies Lab @ CS Department in Moscow State University, Microsoft Research, and Windows' PC|3 Division. Published an internal paper on "Windows Semantic Platform" in Bill Gates' project ThinkWeek. Its ideas were later used in the Microsoft Productivity Future Vision 2009 video. Popularized context-aware computing at World Usability Day Russia 2008 and other events.
Went through internship at Microsoft Research (Redmond, WA, USA) in VIBE Team in the Summer 2010.
Joined Google Russia as a Technical Program Manager II as a Developer Relations Lead for Russia & CIS.
Started own company Zet Universe, Inc. in 2012 and worked for it till Summer 2017. Main product was a dashboard for project and product managers that aggregated, categorized and visualized information from different data sources organized by projects. Built personal knowledge graph and local information indexing, processing, and enrichment platform for Windows with Lucene.Net, entity extraction & disambiguation with linking to WikiData (through Finch for Text and later Dandelion). 
Joined Yandex in 2017 as a Senior Product Manager in Yandex Mail Team. Led and shipped modern scalable information categorization and knowledge extraction platform for Yandex Mail and Alice. Platform enables such experiences as Mail Lists Management (subscribe/unsubscribe from mail lists), rich information visualization in emails (e.g., air tickets), ad audience generation, etc. Jumpstarted and shipped ToDos and Reminders scenarios for Yandex Alice that work across mobile devices with Alice and home speakers beginning with Yandex Station.
Left Yandex in 2018 to start own consulting practice in the area of cognitive computing product development. Among current and past customers - a startup in the area of Social & News Media Analysis in Moscow, Intelligent Autonomous Machines Platform startup in Seattle, WA, USA, as well as Conversational AI startup in Boston, MA, USA.

Awards:
One of 4 Russian startups @ MassChallenge 2013, Top-50 Finalist Pioneers Festival 2012, Intel Ultrabook Developer Experience Award 2012, Microsoft Ship-It Award 2009, Microsoft CEE CPE Award 2009




Academic Interests
AI assistants, knowledge building systems

email: daniel@kornevs.org

Le The Anh

Researcher, MSc., Ph.D. Student

Education
2012: Received the MSc. degree in Computer Science from University of Engineering and Technology, Vietnam National University, Hanoi, Viet Nam.

Currently: Ph.D. student at Moscow Institute of Physics and Technology, Dolgoprudny, Russia.
Professional experience
2011 - 2015: Lecturer at Aptech Computer Education, Hai Phong, Viet Nam.

Currently: Lecturer at Faculty of Information Technology, Vietnam Maritime University; Researcher at Neural Networks and Deep Learning Lab - MIPT
Academic Interests
Machine learning algorithms for Natural Language Processing tasks
Applications of Deep Learning in Computer Vision

email: theanhvmu@gmail.com

Denis Kuznetsov

Researcher

Education
In 2017 MS of electrical engineering, NRU MIPhI
Professional experience
Since 2017, Junior researcher in the laboratory of Neural systems and deep training at MIPT
Academic Interests
Neural network learning models, evolution of adaptive systems and evolutionary algorithms, neurocontrollers, robotics, embedded systems, data analysis, machine learning.

email: kuznetsov.den.p@mail.ru

Eugene Golikov

Researcher

Education
Specialist in Mechanics
Master Student in Data Science
Professional experience
2013 - 2017: senior laboratory assistant in Institute of Space Research, Russian Academy of Sciences
2017 - now: junior research fellow in Neural Systems and Deep Learning Lab, Moscow Institute of Physics and Technology
Academic Interests
Reinforcement learning, Bayesian methods in machine learning

email: golikov.ea@mipt.ru

Anton Peganov

Researcher

Education
In 2014 graduated with a Bachelor of Applied Mathematics and Physics from Department of Biological and Medical Physics of MIPT
Professional experience
Starting in 2017, programmer at Neural Networks and Deep Learning Lab
Academic Interests
Meta-learning application in NLP problems, mathematical optimization, hierarchical recurrent neural networks

email: peganov@phystech.edu

Dmitry Karpov

Researcher

Education
B.Sc. with honors, Applied Mathematics and Physics (MIPT,2016); M.Sc. with honors, Applied Mathematics and Computer Science(MIPT, 2019)


Professional experience
I worked as a software developer in Tinkoff Bank and in the Mipt Neuro robotics lab.

Awards:
DeepHack.Chat hackathon winner

email: dimakarp19962008@yandex.ru

Daniil Cherniavskii

Researcher

Education
Bachelor degree at MIPT in 2020

Professional experience
Joined iPavlov in 2019 email: chernyavskiy.dv@phystech.edu

Dmitry Evseev

Researcher

Education
MIPT, master of science
Professional experience
From 2018 researcher in Neural Networks and Deep Learning Lab
Academic Interests
Using knowledge bases in open-domain question answering, language models

email: dmitrij.euseew@yandex.ru

Darya Moroz

Community manager

Education
2013-2017 - Bachelor's degree at DREC MIPT.
2017-2019 - Master's degree at DREC MIPT.

email: darya.moroz@frtk.ru

Anfisa Shelekhina

Administrator

Education
Moscow City Teachers’ Training University - Literary editor
Professional experience
Procurement specialist, editor and author of programs on TV, a teacher of Russian language and literature.

email: shelekhina.aa@mipt.ru 

2019

International Journal of Machine Learning and Computing vol. 9, no. 1, pp. 8-13

A Deep Neural Network Model for the Task of Named Entity Recognition

The Anh Le, Mikhail S. Burtsev

Moscow Institute of Physics and Technology

Dialog-2019

Sentence Level Representation and Language Models in the task of Coreference Resolution for Russian

Le T. A., Petrov M. A., Kuratov Y. M., Burtsev M. S.

Moscow Institute of Physics and Technology

ACL 2019

Continual and Multi-task Reinforcement Learning With Shared Episodic Memory

Artyom Y. Sorokin, Mikhail S. Burtsev

Moscow Institute of Physics and Technology

Dialog-2019

Adaptation of Deep Bidirectional Multilingual Transformers for Russian Language

Kuratov Yuri, Arkhipov Mikhail

Moscow Institute of Physics and Technology

Dialog-2019

Filling the Gaps with Rules and Networks

Alexey Sorokin

Moscow Institute of Physics and Technology

Dialog-2019

Morphological Parsing of Low Resource Languages

Alexey Sorokin

Moscow Institute of Physics and Technology

Workshop NIPS 2019

Loss Landscape Sightseeing with Multi-Point Optimization

Ivan Skorokhodov, Mikhail S. Burtsev

Moscow Institute of Physics and Technology

2020

Workshop AAAI 2020

Goal-Oriented Multi-Task BERT-Based Dialogue State Tracker

Pavel Gulyaev, Mikhail Burtsev, Eugenia Elistratova, Vasily Konovalov, Yuri Kuratov, Leonid Pugachev

Moscow Institute of Physics and Technology

Proceedings of the 4th ICMLSC 2020

Sequence Labeling Approach to the Task of Sentence Boundary Detection

The Anh Le

Moscow Institute of Physics and Technology

Proceedings of the ICML 2020

Towards a General Theory of Infinite-Width Limits of Neural Classifiers

Eugene A. Golikov

Moscow Institute of Physics and Technology

Proceedings of the International Conference "Dialogue 2020"

Exploring the BERT Cross-Lingual Transferability: a Case Study in Reading Comprehension

Konovalov V. P., Gulyaev P. A., Sorokin A. A., Kuratov Y. M., Burtsev M. S.

Moscow Institute of Physics and Technology

Proceedings of the International Conference "Dialogue 2020"

Tagging and Parsing of Multidomain Collections

Alexey Sorokin

Moscow Institute of Physics and Technology

Proceedings of the International Conference "Dialogue 2020"

SPARQL Query Generation for Complex Question Answering with BERT and BiLSTM-Based Model

Evseev D. A. , Arkhipov M. Yu.

Moscow Institute of Physics and Technology

National Research Centre “Kurchatov Institute”
Moscow

National Research Nuclear University MEPhI
Moscow

Moscow Technological Institute
Moscow

Carnegie Mellоn University

McGrill University

UMass Lowell

University of Montreal

Sberbank

Sberbank of Russia

Carnegie Mellon University

Facebook

Maluuba

Sbеrbank

Element AI

Data Monsters

Flint Capital

iDecide

Nvidia

National Technology Initiative

NIPS

IVADO

Facebook Inc.