Skip to content
NeuralForge

05Technical field notes

Field notes on building dependable AI systems.

Practical guides on retrieval-augmented generation, AI agents, LLM evaluation, prompt engineering, embeddings and deploying LLM applications. Written to be read with an editor open.

Topic

Showing 9 of 9 articles

  • FundamentalsGuide8 min read

    Reliable Structured Outputs with JSON Schema and Validation

    When an LLM's output feeds other code, treat it like any untrusted input: define a schema, validate strictly, retry with specific feedback, and fail loudly when the model can't comply.

    By Alex Morgan

  • EvaluationGuide11 min read

    Regression Testing Prompts and Pipelines

    A one-line prompt edit or a model upgrade can quietly break behavior that used to work. This guide shows how to build a golden set, combine deterministic and model-graded checks, and run them in CI so changes ship with evidence.

    By Jordan Lee

  • RAGExplainer9 min read

    Chunking Strategies for Retrieval-Augmented Generation

    How you split documents decides what your retriever can find. This explainer compares fixed-size, recursive, and structure-aware chunking, and shows how to evaluate the choice.

    By Priya Raman

  • DeploymentField note9 min read

    Logging and Tracing LLM Applications

    When an LLM feature misbehaves, the first question is always what exactly the model saw. These field notes cover what to record per call, how to structure spans across a pipeline, and how to keep sensitive data out of your telemetry.

    By Sam Okafor

  • DeploymentGuide10 min read

    Controlling Latency and Cost in LLM Applications

    Latency and cost in LLM systems are driven by a short list of levers: tokens in, tokens out, which model runs, and how often you call it. This guide walks through each lever and the trade-offs that come with pulling it.

    By Sam Okafor

  • EvaluationChecklist8 min read

    A Practical Checklist for Evaluating LLM Outputs

    A repeatable way to decide whether your LLM feature is getting better or worse: define quality, build a representative eval set, layer cheap and expensive checks, and read results honestly.

    By Jordan Lee

  • FundamentalsExplainer9 min read

    Tokens and Context Windows: A Working Engineer's Guide

    Models do not read characters or words; they read tokens, and every request has a fixed token budget. This guide shows how to measure that budget, divide it deliberately, and degrade gracefully when content does not fit.

    By Alex Morgan

  • RAGGuide9 min read

    RAG vs. Fine-Tuning: Choosing the Right Approach

    Retrieval and fine-tuning solve different problems. This guide breaks down what each one actually changes, where each tends to fail, and how to decide with evidence instead of instinct.

    By Priya Raman

Move from experimenting with AI to engineering it.

Build the foundations, projects, and habits needed to design more dependable AI applications.