Hackathon Challenge
Develop an innovative application, tool, or interactive element leveraging the capabilities of Falcon LLMs. Excited to see where your creativity takes you!
Next Hackathon
Band of Agents Hackathon
Starts Jun 12, 2026
0
Falcon LLMs Hackathon sponsored by GAIA
Join us for an exhilarating 4-days hackathon centered around Falcon LLMs, a cutting-edge language model. The hackathon is sponsored by GAIA, the leading startup acceleration program, providing participants with the opportunity to apply for the next cohort and build innovative companies in Saudi Arabia.
Discover Falcon Models
Falcon LLMs, ranging from 7 billion to a staggering 180 billion parameters, represent a leap in language modeling. These decoder-only models, sculpted by TII, are sculpted from a vast ocean of data – 1,000 billion tokens of RefinedWeb, augmented with carefully curated corpora. Most importantly, they're yours to explore under the Apache 2.0 license.
Why Falcon LLMs?
- Elevating Open Source: Falcon LLMs stand tall as the reigning champions in the open-source arena, consistently surpassing rivals like LLaMA, StableLM, RedPajama, and MPT.
- A Symphony of Efficiency: Marvel at an architecture fine-tuned for inference, boasting FlashAttention (courtesy of Dao et al., 2022) and the multiquery feature (a nod to Shazeer et al., 2019).
- Boundless Possibilities: The Apache 2.0 license grants you the freedom of commercial use, unrestricted by royalties or encumbrances.
Key Highlights
- A License to Innovate: Falcon LLMs are covered by the Apache 2.0 license.
- Leading the Pack: Proven superiority over competitors (check the OpenLLM Leaderboard).
- Optimized Brilliance: Fine-tuned for inference with FlashAttention and the multiquery architecture.
- Torchbearer: Requires PyTorch 2.0 for seamless integration with transformers.
Falcon Model Resources
- **Falcon Models Tech Page on lablab.ai for a quick start.
- Falcon-180B Demo: Falcon-180B firsthand through our interactive demo, an exploration like no other.
- Falcon-40B Documentation: Dive deep into comprehensive documentation, offering installation guides, detailed instructions, and fine-tuning tips.
- Falcon-7B Model: Uncover the 7B model and its intricate details.
- Falcon RefinedWeb Dataset: Enhance your projects by tapping into the power of the Falcon RefinedWeb dataset, an ideal companion for fine-tuning Falcon-40B.
Launch Your StartUp Adventure
GAIA StartUp Accelerator
Experience the exceptional generosity of GAIA, the renowned startup accelerator, which is the proud sponsor of this Hackathon. This is your opportunity to leverage GAIA's extensive benefits and propel your AI innovations forward.
Hackathon Preparation
Prepare effectively for the Falcon LLMs Hackathon with these three phases:
Prepare
- Embark on your journey by immersing yourself in the Falcon models' documentation to unlock their full potential. Forge your development environment, equipped with the requisite software and hardware
Innovation Unleashed
- Strategically plan your project with clear objectives. Emmerse yourself in Falcon LLMs, experimenting with guidance from the documentation.
Shine Bright
- Craft an engaging project demo that spotlights the profound impact of Falcon models in your work.
StartUp Opportunities
For lablab.ai Community members who shine during lablab.ai Hackathons, the opportunity may arise to join partner startup accelerator programs such as GAIA's and Slingshot.
Hackathon Details
Join lablab.ai for a 4-days challenge to innovate and build with Falcon LLMs. Find all the relevant details below.
🗓️ Where and when
The hackathon will start on October 26th.
The hackathon will take place online on lablab.ai platform and lablab.ai Discord Server. Please register for both in order to participate. To participate click the "Enroll" button at the bottom of the page and read our Hackathon Guidelines and Getting Started Guide.
😅 What about teams?
If you don't have a team, don't worry! You can connect with other participants from all over the world on our dashboard or Discord server. We also recommend checking out our Discord server to find teammates and bounce around ideas. You can join the server here
🧠 Get prepared / Use Lablab.ai to Learn About AI
To get ready for the hackathon, visit our AI Tech pages and read up on all the available technologies. You can also check out our tutorials page for more information on how to use them. Get a head start on your project by using the resources on lablab.ai!
Speakers, Mentors and Organizers
.png&w=3840&q=75)
MentorShebagi Mitra
Student
OrganizerHaneen Salih
Community Manager
OrganizerDina Shall
Global Community Manager
Event Schedule
- To be announced
Winner Submissions 🏆
Submitted concepts, prototypes and pitches
Submissions from the teams participating in the Falcon LLMs Hackathon sponsored by GAIA event and making it to the end 👊
Teams: Falcon LLMs Hackathon sponsored by GAIA
Check out the roster and find teams to join
.png&w=3840&q=75)
.png&w=3840&q=75)
.png&w=3840&q=75)
.png&w=3840&q=75)
Next Hackathon
Band of Agents Hackathon
Starts Jun 12, 2026