devxlogo

Challenges of using LLMs in development

LLMs Challenges
LLMs Challenges

Josh Taylor, a senior business leader in data science, highlights the challenges of using Large Language Models (LLMs) in software development. He points out that the lack of internal structure in current AI systems makes it difficult for developers to use them as reusable components within larger systems. Taylor explains that without a meaningful internal structure, it’s impossible to implement a separation of concerns, which is a fundamental principle in software development.

This principle ensures that different sections of a program handle distinct tasks, making the code more manageable and scalable. Using LLMs for specific Software Development Lifecycle Activities (SDLC) also presents challenges. While they can assist in various stages of development, from coding to deployment, their integration into these processes reveals distinct obstacles.

Challenges with LLM integration in SDLC

For example, AI-based coding tools must be seamlessly integrated into existing workflows. However, their current limitations can disrupt the typical development pipeline.

Ensuring quality in outputs generated by LLMs is another concern. Developers often need to invest additional time in verifying and refining AI-generated code, which can offset the intended efficiency gains. In summary, while LLMs have potential for assisting with certain software development tasks, their practical application is hindered by several critical issues.

The lack of internal structure and reusability constrains their effectiveness within the development cycle. As AI technology evolves, addressing these challenges will be crucial for unlocking its full potential in software development.

About Our Editorial Process

At DevX, we’re dedicated to tech entrepreneurship. Our team closely follows industry shifts, new products, AI breakthroughs, technology trends, and funding announcements. Articles undergo thorough editing to ensure accuracy and clarity, reflecting DevX’s style and supporting entrepreneurs in the tech sphere.

See our full editorial policy.