{"id":16318,"date":"2026-08-26T12:42:16","date_gmt":"2026-08-26T10:42:16","guid":{"rendered":"https:\/\/optano.com\/?p=16318"},"modified":"2026-08-27T09:34:09","modified_gmt":"2026-08-27T07:34:09","slug":"llms-and-operations-research-benchmarking-for-an-optano-decision-making-framework","status":"publish","type":"post","link":"https:\/\/optano.com\/en\/abschlussarbeiten\/llms-und-operations-research-benchmarking-fuer-einen-optano-entscheidungskatalog\/","title":{"rendered":"Bachelor's\/Master's Thesis: LLMs and Operations Research: Benchmarking for an OPTANO Decision Catalog"},"content":{"rendered":"
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Sounds interesting? Here's the specific research question:<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Benchmarking of LLM features related to OR software to develop an OPTANO decision catalog for various use cases<\/p>

  • OPTANO already solves the actual operations research scenario. The research question, therefore, is not whether LLMs can replace the optimization problem, but rather in which related use cases they provide reliable added value.<\/li>
  • The goal is to examine how well various LLM features perform in typical use cases such as data science, what-if analyses, explainability, interpretation of results, and user interaction.<\/li>
  • It also remains to be seen which technical \u201eapproaches\u201c are appropriate depending on customer requirements\u2014for example, simple prompting versus retrieval, single-agent versus multi-agent\u2014and how these variations affect cost, runtime, and quality.<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t
    \n\t\t\t\t\t
    \n\t\t\t\t
    \n\t\t\t\t
    \n\t\t\t\t\t\t\t
    \n\t\t\t\n\t\t\t\t\t\t<\/span>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t
    \n\t\t\t\t
    \n\t\t\t\t
    \n\t\t\t\t\t

    Here is how we envision this methodology:<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
    \n\t\t\t\t
    \n\t\t\t\t\t\t\t\t\t
    • Development of a benchmark framework for several clearly defined use cases related to an existing OPTANO scenario, such as data analysis, scenario comparison, explanation of solutions, or answering technical inquiries.<\/li>
    • A systematic comparison of various LLM setups based on defined metrics such as response quality, factual accuracy, processing time, cost, robustness, and the engineering effort required.<\/li>
    • Development of a practical decision-making framework with reusable base templates from which appropriate LLM architectures can be selected based on the use case and customer requirements.<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t
      \n\t\t\t\t\t
      \n\t\t\t\t
      \n\t\t\t\t
      \n\t\t\t\t\t\t\t
      \n\t\t\t\n\t\t\t\t\t\t<\/span>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t
      \n\t\t\t\t
      \n\t\t\t\t
      \n\t\t\t\t\t

      You'll need the following knowledge:<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t
      \n\t\t\t\t
      \n\t\t\t\t
      \n\t\t\t\t\t\t\t
        \n\t\t\t\t\t\t\t
      • \n\t\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t<\/path><\/path><\/svg>\t\t\t\t\t\t<\/span>\n\t\t\t\t\t\t\t\t\t\tStrong knowledge of mathematical optimization or operations research<\/span>\n\t\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t\t\t
      • \n\t\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t<\/path><\/path><\/svg>\t\t\t\t\t\t<\/span>\n\t\t\t\t\t\t\t\t\t\tProgramming experience in Python and an interest in experimental evaluation and benchmark design<\/span>\n\t\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t\t\t
      • \n\t\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t<\/path><\/path><\/svg>\t\t\t\t\t\t<\/span>\n\t\t\t\t\t\t\t\t\t\tBasic Knowledge of LLMs, Prompting, Retrieval, and Agent-Based Architectures<\/span>\n\t\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t<\/ul>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t
        \n\t\t\t\t\t
        \n\t\t\t\t
        \n\t\t\t\t
        \n\t\t\t\t\t\t\t
        \n\t\t\t\n\t\t\t\t\t\t<\/span>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t
        \n\t\t\t\t
        \n\t\t\t\t
        \n\t\t\t\t\t

        Apply now!<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>","protected":false},"excerpt":{"rendered":"

        Klingt interessant? Das ist die konkrete Forschungsfrage: Benchmarking von LLM-Features rund um OR-Software zur Ableitung eines OPTANO-Entscheidungskatalogs f\u00fcr unterschiedliche Use Cases OPTANO l\u00f6st bereits das eigentliche Operations-Research-Szenario. Die Forschungsfrage ist daher nicht, ob LLMs das Optimierungsproblem ersetzen, sondern bei welchen begleitenden Use Cases sie einen verl\u00e4sslichen Mehrwert liefern. Zu untersuchen ist, wie gut verschiedene LLM-Features […]<\/p>\n","protected":false},"author":3,"featured_media":16334,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[194],"tags":[],"class_list":["post-16318","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-abschlussarbeiten"],"acf":[],"_links":{"self":[{"href":"https:\/\/optano.com\/en\/wp-json\/wp\/v2\/posts\/16318","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/optano.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/optano.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/optano.com\/en\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/optano.com\/en\/wp-json\/wp\/v2\/comments?post=16318"}],"version-history":[{"count":15,"href":"https:\/\/optano.com\/en\/wp-json\/wp\/v2\/posts\/16318\/revisions"}],"predecessor-version":[{"id":16537,"href":"https:\/\/optano.com\/en\/wp-json\/wp\/v2\/posts\/16318\/revisions\/16537"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/optano.com\/en\/wp-json\/wp\/v2\/media\/16334"}],"wp:attachment":[{"href":"https:\/\/optano.com\/en\/wp-json\/wp\/v2\/media?parent=16318"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/optano.com\/en\/wp-json\/wp\/v2\/categories?post=16318"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/optano.com\/en\/wp-json\/wp\/v2\/tags?post=16318"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}