Ales Kubicek

Ales Kubicek

MSc Computer Science Student @ ETH Zurich

I am a final year MSc student, currently focusing on my master's thesis and research projects.

I am fortunate to work with and be mentored by Dr. Maciej Besta and Prof. Torsten Hoefler as part of the Scalable Parallel Computing Laboratory (SPCL) at ETH Zurich.

Before coming to ETH Zurich, I completed my BSc in Computer Science at The University of Manchester.

Interests

Performance, Parallelism and Scalability icon

Performance, Parallelism and Scalability

Advancing techniques to optimize and scale important workloads such as pre-training, fine-tuning or inference of LLMs. Running, tracing and debugging these workloads at scale.

HPC icon

HPC

Improving components of the High-Performance Computing (HPC) stack, such as interconnect, to allow for performance improvements of important workloads.

Systems icon

Systems / ML Systems

Designing, building, testing, optimizing and deploying complex (ML) systems.

Research Experience

SPCL logo

Graduate Student Researcher

Feb 2023 - Present

SPCL | ETH Zurich

Researching performance optimizations of large-scale LLM workloads, LLM ecosystem and improvements in low-diameter HPC networks.

Supervised by Dr. Maciej Besta and Prof. Torsten Hoefler

Publications

Multi-Head RAG: Solving Multi-Aspect Problems with LLMs

M. Besta, A. Kubicek, R. Niggli, R. Gerstenberger, L. Weitzendorf, M. Chi, P. Iff, J. Gajda, P. Nyczyk, J. Müller, H. Niewiadomski, M. Chrapek, M. Podstawski, T. Hoefler

Edge-Disjoint Spanning Trees on Star-Product Networks

A. Dawkins, K. Isham, A. Kubicek, K. Lakhotia, L. Monroe

Graph of thoughts: Solving elaborate problems with large language models

M. Besta, N. Blach, A. Kubicek, R. Gerstenberger, L. Gianinazzi, J. Gajda, T. Lehmann, M. Podstawski, H. Niewiadomski, P. Nyczyk, T. Hoefler

CheckEmbed: Effective Verification of LLM Solutions to Open-Ended Tasks

M. Besta, L. Paleari, A. Kubicek, P. Nyczyk, R. Gerstenberger, P. Iff, T. Lehmann, H. Niewiadomski, T. Hoefler

A High-Performance Design, Implementation, Deployment, and Evaluation of The Slim Fly Network

N. Blach, M. Besta, D. De Sensi, J. Domke, H. Harake, S. Li, M. Konieczny, P. Iff, K. Lakhotia, A. Kubicek, M. Ferrari, F. Petrini, T. Hoefler

Topologies of Reasoning: Demystifying Chains, Trees, and Graphs of Thoughts

M. Besta, F. Memedi, Z. Zhang, R. Gerstenberger, N. Blach, P. Nyczyk, M. Copik, G. Kwaśniewski, J. Müller, L. Gianinazzi, A. Kubicek, H. Niewiadomski, O. Mutlu, T. Hoefler

TornadoQSim: An Open-Source High-Performance and Modular Quantum Circuit Simulation Framework

A. Kubicek, A. Stratikopoulos, J. Fumero, N. Foutris, C. Kotselidis

Work Experience

JAG logo

Software Engineer

Aug 2021 - Present

JAG Jakob AG

Worked on the entire product lifecycle of designing, implementing, and deploying a microservice-based production management system (IPM). Led the effort of developing LLM agents to allow for natural language interaction with the system.

Working student | Remote

WHS logo

Software Engineer

Jun 2018 - Aug 2021

WHS-Handling spol. s r.o.

Worked on the design and implementation of communication protocols, scheduling and task processing for a production management system. Deployed, tested, and maintained these solutions in a production environment.

Working student | Remote

Academic Awards

Outstanding Academic Achievement Award

Ranked in the top 0.5% (32 out of 6500 students) university-wide for overall academic performance.

Award icon

2021 | The University of Manchester

Certificate of Excellence

Among top 10% out of 300 graduating students from the Department of Computer Science, based on academic performance.

Award icon

2021 | The University of Manchester

Edward’s Prize

Recognized as the top student in the Computer Engineering track, based on academic performance and project work.

Award icon

2021 | The University of Manchester

Kilburn Entry Scholarship

Among top 30% out of 300 incoming Computer Science students, based on pre-university academic performance.

Award icon

2018 | The University of Manchester

Other

JAG logo

Board Member

May 2023 - Present

Czech and Slovak Students in Zurich

Responsible for finances, including budgeting, maintaining the balance sheet, and ensuring compliance with legal requirements of the society. Additionally, helping with organising events to strengthen the Czech and Slovak student community. (cssz.ch)