profile picture

David Herel

Co-Founder & Head of Development at BottleCap AI
Making Large Language Models Radically More Efficient.
Previously: Co-founded Hive Spirit Technologies, Senior Researcher at NUS
Prague, Czech Republic
dherel@bottlecapai.com
I am the Co-Founder & Head of Development at BottleCap AI, where we're redefining large language models (LLMs) to make AI radically more efficient. Our startup has gained international recognition, backed by a $10M initial investment from Jaroslav Beck. Previously, I co-founded Hive Spirit Technologies, building cutting-edge algorithmic trading models with Tomas . My AI research has been published in prestigious venues like ICLR and ECAI, and I led projects recognized by Amazon's Alexa Prize Socialbot Grand Challenge. If you’re interested in collaboration, investments, or media commentary, feel free to reach out.

News

3/3/2025 Launched BottleCap AI, aiming to revolutionize LLM efficiency. Featured in Forbes and CzechCrunch - 10M USD investment.
1/2/2025 Completed an internship at the National University of Singapore under Prof. Michael Shieh.
1/5/2024 Launched an algorithmic trading startup Hive Spirit Technologies LLC with Tomas Mikolov.
1/4/2024 Our paper Collapse of self-trained langauge models got accepted to ICLR 2024 as notable top-5% (Oral). (HackerNews discussion, arxiv)
5/3/2024 Interview for various news media about my language modeling research. (Forbes, CTK, Novinky, AI institute)
12/9/2023 We have won 3rd place in prestigious Alexa Prize Socialbot Grand Challenge 5 with team Alquist AI.
25/7/2023 Our paper on Preserving Semantics in Textual Adversarial Attacks got accepted to ECAI 2023. Notable-top-5% (Oral).
28/2/2021 Awarded with a GoodAI grant for the Emergence of Novelty research.

Notable publications

Collapse of self-trained language models David Herel and Tomas Mikolov In International Conference on Learning Representations, 2024 (notable).
ICLR 2024 (notable)
Alquist 5.0: Dialogue Trees Meet Generative Models. A Novel Approach for Enhancing SocialBot Conversations Ondrej Kobza, Jan Cuhel, Tommaso Gargiani, David Herel, Petr Marek, Jan Pichl, Jakub Konrad, Petr Lorenc and Jan Sedivy In Amazon Science, 2023.
Amazon Science 2023
On Difficulties of Attention Factorization through Shared Memory Uladzislau Yorsh, Martin Holeňa, Ondřej Bojar, David Herel In International Conference on Learning Representations, 2023.
ICLR 2023
Preserving Semantics in Textual Adversarial Attacks David Herel and Hugo Cisneros and Tomas Mikolov In European Conference on Artificial Intelligence Proceedings, 2023.
ECAI 2023
Thinking Tokens for Language Modeling David Herel and Tomas Mikolov In Artificial Intelligence and Theorem Proving Proceedings, 2023.
AITP 2023
Emergence of Novelty in Evolutionary Algorithms David Herel and Dominika Zogatova and Matej Kripner and Tomas Mikolov In Artificial Life Conference Proceedings, 2022.
ALIFE 2022