• Know the basic principles of parallel and distributed computing;
• Know the basic classes of parallel computing systems, features of their architecture and programming, methods for evaluating performance;
• Know the application of distributed systems in different areas;
• Know the basic parallel methods of problem solving;
• Know the basics of parallel and distributed computing technologies;
• be able to develop parallel algorithms;
• be able to design and adapt parallel and distributed software;
• be able to develop requirements and specifications for hardware and software for the implementation of parallel computing;
• be able to identify, calculate and analyze the performance of parallel algorithms and programs;
• Be able to assess the complexity and effectiveness of programs using modern profiling tools.

Prerequisites:
• Theory of algorithms
• Object-Oriented Programming
• System programming
Сo-requisites:
• Cloud technologies

Purpose, tasks and goals of parallel data processing. Principles of construction of parallel computing systems. Methods of parallelization and organization of calculations in multiprocessor systems. Basic algorithms for parallel computing. Parallel methods for solving problems of combinatorics and graph theory. OpenMP technology. MPI technology. Technology C ++ Threads. Methods of parallelization and organization of calculations. Multi-threaded programming based on OpenMP technology. Distributed programming based on MPI technology. Collective computing. Distributed programming based on MPI technology. Point-to-point calculation. Multithreaded programming based on C ++ Threads technology.

• Аксак Н.Г., Руденко О.Г., Гуржій А.М. Паралельні та розподілені обчислення: підручник. – Х.: Компанія СМІТ, 2009. – 480 с.
• Воеводин В.В., Воеводин Вл.В. Параллельные вычисления – СПб.: БХВ-Петербург, 2002. – 608 с.
• Гергель В.П. Теория и практика параллельных вычислений – М.:ИНТУИТ.РУ Интернет-Университет Информационных технологий; БИНОМ. Лаборатория знаний, 2007. – 423 с: ил., табл.
• Таненбаум Э., ван Стеен М. Распределенные системы. Принципы и парадигмы – СПб.: Питер, 2003. – 877 с.: ил.
• Эндрюс Г.Р. Основы многопоточного, параллельного и распределенного программирования – М.: Издательский дом «Вильямс», 2003. – 512 с.: ил.
• Уильямс Э. Параллельное программирование на C++ в действии. Практика разработки многопоточных программ. – М.: ДМК Пресс, 2012. – 672 с: ил.
• Эхтер Ш., Робертс Дж. Многоядерное программирование. – СПб.: Питер, 2010. — 316 с: ил.

written reports on laboratory work, oral examination (40%)
final control (exam): written-oral form (60%)

• know the basic principles of operation of parallel and distributed computings;
• know the basic classes of parallel computing systems;
• know the level of computations parallelization, especially their architecture and programming;
• be able to determine the type and characteristics of the existing equipment and choose the most effective implementation depending on the task;
• be able to develop parallel applications by using modern technologies.

• Algorithmic Theory
• Object-oriented Programming
• Distributed Database Systems and Knowledge
• Technology of Business Logic Designing

Basic concepts and problems of distributed systems. The basic properties of distributed systems: transparency, openness and scalability. Concept of hardware and software solutions when building distributed systems. Multiprocessors. Homogeneous and heterogeneous systems. Distributed and network operating systems. Providing communication and processes in distributed systems. Synchronization and replication. Resilience and protection of distributed systems. Errors masking and replication. Distributed Systems of objects: C0RBA, DCOM, Globe. Parallel computing systems. Scalar, pipelined and parallel processing. Moore's Law. Special processors. Superscalar and VLIW architecture. Switching schemes. SMP computers. NUMA and eeNUMA architectures. Systems of functional devices and classifications of Flynn, Hockney, Feng Hendler, Schneider, Skilkorn. The architecture of parallel systems. Vector-conveyor computers. Parallel computers with shared memory. Computing systems with distributed memory. The performance of parallel computers. GRID concept and meta computing. Graph of algorithms and parallel computing. Technologies of parallel programming. Means of parallel programming. Programming systems OpenMP, DVM and MPC.

1. Таненбаум Э. Распределенные системы. Принципы и парадигмы / Э. Таненбаум – Спб.: Питер, 2010. – 877 с.
2. Уильямс Э. Параллельное программирование на С++ в действии. Практика разработки многопоточных программ / Э.Уильямс - М.: ДМК Пресс, 2012. - 672с.
3. Эндрюс Г. Основы многопоточного, параллельного и распределенного программирования/ Г. Эндрюс – М.: Вильямс, 2010. – 512 с.
4. Воеводин В.В. Параллельные вычисления. /В. Воеводин – СПб.: БХВ-Петербург, 2010. – 312с.

• Current control (40%): written reports on laboratory work, settlement and graphic work, oral examination;
• Final control (60% of exam): in written, verbally.