Close Menu
    DevStackTipsDevStackTips
    • Home
    • News & Updates
      1. Tech & Work
      2. View All

      The Power Of The Intl API: A Definitive Guide To Browser-Native Internationalization

      August 8, 2025

      This week in AI dev tools: GPT-5, Claude Opus 4.1, and more (August 8, 2025)

      August 8, 2025

      Elastic simplifies log analytics for SREs and developers with launch of Log Essentials

      August 7, 2025

      OpenAI launches GPT-5

      August 7, 2025

      I compared the best headphones from Apple, Sony, Bose, and Sonos: Here’s how the AirPods Max wins

      August 10, 2025

      I changed these 6 settings on my iPad to significantly improve its battery life

      August 10, 2025

      DistroWatch Weekly, Issue 1134

      August 10, 2025

      3 portable power stations I travel everywhere with (and how they differ)

      August 9, 2025
    • Development
      1. Algorithms & Data Structures
      2. Artificial Intelligence
      3. Back-End Development
      4. Databases
      5. Front-End Development
      6. Libraries & Frameworks
      7. Machine Learning
      8. Security
      9. Software Engineering
      10. Tools & IDEs
      11. Web Design
      12. Web Development
      13. Web Security
      14. Programming Languages
        • PHP
        • JavaScript
      Featured

      Next.js PWA offline capability with Service Worker, no extra package

      August 10, 2025
      Recent

      Next.js PWA offline capability with Service Worker, no extra package

      August 10, 2025

      spatie/laravel-flare

      August 9, 2025

      Establishing Consistent Data Foundations with Laravel’s Database Population System

      August 8, 2025
    • Operating Systems
      1. Windows
      2. Linux
      3. macOS
      Featured

      Windows 11 Copilot gets free access to GPT-5 Thinking, reduced rate limits than ChatGPT Free

      August 10, 2025
      Recent

      Windows 11 Copilot gets free access to GPT-5 Thinking, reduced rate limits than ChatGPT Free

      August 10, 2025

      Best Architecture AI Rendering Platform: 6 Tools Tested

      August 10, 2025

      Microsoft won’t kill off Chromium Edge and PWAs on Windows 10 until October 2028

      August 10, 2025
    • Learning Resources
      • Books
      • Cheatsheets
      • Tutorials & Guides
    Home»Development»Machine Learning»OpenAI Releases Reinforcement Fine-Tuning (RFT) on o4-mini: A Step Forward in Custom Model Optimization

    OpenAI Releases Reinforcement Fine-Tuning (RFT) on o4-mini: A Step Forward in Custom Model Optimization

    May 9, 2025

    OpenAI has launched Reinforcement Fine-Tuning (RFT) on its o4-mini reasoning model, introducing a powerful new technique for tailoring foundation models to specialized tasks. Built on principles of reinforcement learning, RFT allows organizations to define custom objectives and reward functions, enabling fine-grained control over how models improve—far beyond what standard supervised fine-tuning offers.

    At its core, RFT is designed to help developers push models closer to ideal behavior for real-world applications by teaching them not just what to output, but why that output is preferred in a particular domain.

    What is Reinforcement Fine-Tuning?

    Reinforcement Fine-Tuning applies reinforcement learning principles to language model fine-tuning. Rather than relying solely on labeled examples, developers provide a task-specific grader—a function that evaluates and scores model outputs based on custom criteria. The model is then trained to optimize against this reward signal, gradually learning to generate responses that align with the desired behavior.

    This approach is particularly valuable for nuanced or subjective tasks where ground truth is difficult to define. For instance, you might not have labeled data for “the best way to phrase a medical explanation,” but you can write a program that assesses clarity, correctness, and completeness—and let the model learn accordingly.

    Why o4-mini?

    OpenAI’s o4-mini is a compact reasoning model released in April 2025, optimized for both text and image inputs. It’s part of OpenAI’s new generation of multitask-capable models and is particularly strong at structured reasoning and chain-of-thought prompts.

    By enabling RFT on o4-mini, OpenAI gives developers access to a lightweight yet capable foundation that can be precisely tuned for high-stakes, domain-specific reasoning tasks—while remaining computationally efficient and fast enough for real-time applications.

    Applied Use Cases: What Developers Are Building with RFT

    Several early adopters have demonstrated the practical potential of RFT on o4-mini:

    • Accordance AI built a custom tax analysis model that improved accuracy by 39% over baseline, using a rule-based grader to enforce compliance logic.
    • Ambience Healthcare used RFT to enhance medical coding accuracy, boosting ICD-10 assignment performance by 12 points over physician-written labels.
    • Harvey, a legal AI startup, fine-tuned a model to extract citations from legal documents with a 20% improvement in F1, matching GPT-4o on performance at reduced latency.
    • Runloop trained the model to generate valid Stripe API snippets, achieving a 12% gain using AST validation and syntax-based grading.
    • Milo, a scheduling assistant, improved output quality on complex calendar prompts by 25 points.
    • SafetyKit boosted content moderation accuracy in production from 86% to 90% F1 by enforcing granular policy compliance through custom grading functions.

    These examples underscore RFT’s strength in aligning models with use-case-specific requirements—whether those involve legal reasoning, medical understanding, code synthesis, or policy enforcement.

    How to Use RFT on o4-mini

    Getting started with Reinforcement Fine-Tuning involves four key components:

    1. Design a Grading Function: Developers define a Python function that evaluates model outputs. This function returns a score from 0 to 1 and can encode task-specific preferences, such as correctness, format, or tone.
    2. Prepare a Dataset: A high-quality prompt dataset is essential. OpenAI recommends using diverse and challenging examples that reflect the target task.
    3. Launch a Training Job: Via OpenAI’s fine-tuning API or dashboard, users can launch RFT runs with adjustable configurations and performance tracking.
    4. Evaluate and Iterate: Developers monitor reward progression, evaluate checkpoints, and refine grading logic to maximize performance over time.

    Comprehensive documentation and examples are available through OpenAI’s RFT guide.

    Access and Pricing

    RFT is currently available to verified organizations. Training costs are billed at $100/hour for active training time. If a hosted OpenAI model is used to run the grader (e.g., GPT-4o), token usage for those calls is charged separately at standard inference rates.

    As an incentive, OpenAI is offering a 50% training cost discount for organizations that agree to share their datasets for research and model improvement purposes.

    A Technical Leap for Model Customization

    Reinforcement Fine-Tuning represents a shift in how we adapt foundation models to specific needs. Rather than merely replicating labeled outputs, RFT enables models to internalize feedback loops that reflect the goals and constraints of real-world applications. For organizations working on complex workflows where precision and alignment matter, this new capability opens a critical path to reliable and efficient AI deployment.

    With RFT now available on the o4-mini reasoning model, OpenAI is equipping developers with tools not just to fine-tune language—but to fine-tune reasoning itself.


    Check out the Detailed Documentation here. Also, don’t forget to follow us on Twitter.

    Here’s a brief overview of what we’re building at Marktechpost:

    • ML News Community – r/machinelearningnews (92k+ members)
    • Newsletter– airesearchinsights.com/(30k+ subscribers)
    • miniCON AI Events – minicon.marktechpost.com
    • AI Reports & Magazines – magazine.marktechpost.com
    • AI Dev & Research News – marktechpost.com (1M+ monthly readers)

    The post OpenAI Releases Reinforcement Fine-Tuning (RFT) on o4-mini: A Step Forward in Custom Model Optimization appeared first on MarkTechPost.

    Source: Read More 

    Facebook Twitter Reddit Email Copy Link
    Previous ArticleMing-Lite-Uni: An Open-Source AI Framework Designed to Unify Text and Vision through an Autoregressive Multimodal Structure
    Next Article Meta AI Open-Sources LlamaFirewall: A Security Guardrail Tool to Help Build Secure AI Agents

    Related Posts

    Machine Learning

    How to Evaluate Jailbreak Methods: A Case Study with the StrongREJECT Benchmark

    August 10, 2025
    Machine Learning

    AI Agent Trends of 2025: A Transformative Landscape

    August 10, 2025
    Leave A Reply Cancel Reply

    For security, use of Google's reCAPTCHA service is required which is subject to the Google Privacy Policy and Terms of Use.

    Continue Reading

    CVE-2023-53133 – Apache Linux bpf Infinite Loop Vulnerability

    Common Vulnerabilities and Exposures (CVEs)

    CVE-2025-3499 – Apache OS Command Injection Vulnerability

    Common Vulnerabilities and Exposures (CVEs)

    CVE-2023-50338 – Apache HTTP Server SQL Injection

    Common Vulnerabilities and Exposures (CVEs)

    Discover the Average Cost for Website Redesign: What to Expect in 2025

    Web Development

    Highlights

    How to Budget Smartly for Your First AI Project: A Step-by-Step Guide

    May 2, 2025

    Post Content Source: Read More 

    CVE-2025-6745 – WoodMart WordPress Information Exposure Vulnerability

    July 11, 2025

    Trend Micro Fortifies AI Security: Integrates NVIDIA Agentic AI Safety for End-to-End Protection

    June 17, 2025

    Arondite secures $10M to strengthen human-machine cooperation in defence

    May 2, 2025
    © DevStackTips 2025. All rights reserved.
    • Contact
    • Privacy Policy

    Type above and press Enter to search. Press Esc to cancel.