Ever felt lost staring at a blank page, unsure how to build those Large Language Model (LLM) pipelines you've been hearing about? Then you need a buddy, an AI buddy: Introducing ChainBuddy! This helpful AI assistant, seamlessly integrated into the open-source ChainForge platform, tackles the dreaded 'blank page problem' head-on. Imagine effortlessly designing and testing different LLM prompts to enhance your LLM workflows. Or perhaps you're trying to compare models? ChainBuddy has you covered. No more fumbling around! Just type in your goal (like "I want to compare how different prompts perform when creating tweets from longer text"), and ChainBuddy chats with you to understand your needs. It asks clarifying questions and helps you fine-tune your goal before generating a starter pipeline, complete with input data, prompt templates, multiple LLMs to query, and even automated evaluations. Our research shows that ChainBuddy helps users feel more confident and significantly reduces their mental workload. It's like having an expert guide, leading you through the LLM pipeline maze! But there's more! Beyond the basics, ChainBuddy helps you learn the ins and outs of LLM pipeline creation and prompt engineering. It surpasses expectations, offering a range of potential uses like evaluating LLMs for bias and handling sensitive topics, streamlining your process, and saving precious time. But is there a catch? We discuss the potential risk of over-reliance on such tools and how future enhancements can help mitigate biases and provide more control to the user. Dive into the future of LLM pipeline creation with ChainBuddy, your new best friend in the AI world.