The digital realm is evolving at an unprecedented pace, with AI-driven technologies pushing the boundaries of what’s possible. On the 20th of August 2023, a remarkable event titled “Next Generation API Interaction: Intelligent Agents and Large Language Models Paving the Way” took place, courtesy of AI-Driven Sri Lanka—an initiative by IEEE Young Professionals Sri Lanka. The virtual gathering via Zoom attracted more than 60 participants, all eager to delve into the fascinating landscape of AI-powered interactions.
Keynote Speakers Illuminate the Path
Figure 01: Keynote Speakers
Two distinguished voices, Dr. Malith Jayasinghe (Ph.D.) and, Mr. Nadheesh Jihan illuminated the event with their insights and expertise. Mr. Jihan, a dynamic force within WSO2’s CTO office, has consistently excelled in his journey from Associate Technical Lead to Senior Research Engineer, driving AI solutions forward. Meanwhile, Dr. Jayasinghe, Vice President of Research and Artificial Intelligence at WSO2, brought over 15 years of software industry experience to the virtual stage.
Laying the Groundwork for Large Language Models
The event began with an enlightening introduction by Dr. Malith Jayasinghe, who navigated through the foundational aspects of Large Language Models (LLMs). The groundbreaking 2017 paper, “Attention is All You Need,” published by Google researchers, introduced transformer architecture—an innovation that revolutionized AI across domains. Initially aimed at language translation tasks, this architecture’s adaptability and efficiency paved the way for diverse applications, from Natural Language Processing to Computer Vision and even Bioinformatics and Audio processing.
Figure 02: Content covered
Unlocking the Power of LLM Usage Patterns
The event delved into the intricacies of LLM usage patterns. Direct access to LLMs through APIs, enriched prompts with external data, fine-tuned LLM API access, and agent-driven actions powered by LLMs were all examined in detail.
Advantages and Disadvantages of Direct LLM Access
While direct LLM access via APIs eliminates training and hosting costs, it comes with limitations tied to model behavior and data privacy concerns.
Enriching Prompts with External Data
This approach enhances context and adaptability but requires careful maintenance of external data sources.
Accessing the Fine-Tuned LLM API: Fine-tuned LLMs offer tailored performance but demand expertise, data, and additional costs.
Agent-Driven Actions Powered by LLMs
Intelligent agents, aided by LLMs, execute natural language commands. Tools like Ballerina AI Agents, Semantic Kernel, Haystack, and others, help agents reason and act efficiently.
Ballerina AI Agents: Automating Integrations
Figure 03: Ballerina AI Agents: Automating Integrations
Mr. Nadheesh Jihan shifted the focus to Ballerina AI Agents, an innovation that automates integrations via code. These agents streamline communication between users and systems by providing a natural chat experience, handling multi-query support, and requiring minimal code.
Ballerina Integration vs. Agent Services
Comparing Ballerina AI Agents with traditional integration methods showcased the efficiency, naturalness, and versatility of the former.
Challenges and Future
While Ballerina AI Agents offer immense potential, they must address user input challenges. This technology provides a glimpse of a more efficient and user-friendly future.
Q&A Session and Conclusion
The event concluded with a vibrant Q&A session, during which participants engaged the speakers with insightful queries. The interplay between the participants’ curiosity and the speakers’ expertise encapsulated the essence of this enlightening event.
In a world increasingly shaped by AI and large language models, the “Next Generation API Interaction” event sheds light on the endless possibilities these technologies offer. With experts like Mr. Nadheesh Jihan and Mr. Malith Jayasinghe leading the discourse, attendees gained valuable insights into leveraging AI’s potential.
Figure 04: Community talk 3 Successfully completed
In conclusion, this event underscored the transformative impact of AI-driven interactions, showcasing how agents and large language models are shaping our digital future. As AI continues to evolve, events like these pave the way for collaborative innovation, propelling us toward a more intelligent and interconnected world.