Planning Benchmark · ADSKAILab
LLM-narrative-planning-taskset
A benchmark evaluating large language model planning and reasoning across multi-step engineering scenarios.
What LLM-narrative-planning-taskset is
LLM-narrative-planning-taskset is a benchmark created by ADSKAILab to evaluate planning and reasoning capabilities in large language models. It specifically targets multi-step engineering and design scenarios, framing evaluations through a narrative planning perspective.
The dataset accompanies research addressing whether large language models can generate coherent stories, providing tasks to examine model performance on multi-step problem solving and scientific reasoning.
Key facts
- Category
- Planning Benchmark
- Fields
- Engineering, scientific-reasoning
- Associated paper
- Can LLMs Generate Good Stories? Insights and Challenges from a Narrative Planning Perspective
What you can use it for
- Benchmarking Multi-Step LLM Planning
- Assessing the ability of language models to plan and reason across extended, sequential engineering scenarios.
- Narrative Planning Evaluation
- Evaluating how models structure and execute plans within narrative and story-generation frameworks.
- Engineering Design Reasoning
- Testing model reasoning on complex, multi-stage engineering and design problems.
Explore the data
No licence declared
The authors have not published a licence, which means no permission to redistribute the data has been granted to anyone. The rows are not served here; read them on the original dataset page.Strengths and limits
Good at
- Targets multi-step reasoning specifically within engineering and design scenarios.
- Connects narrative planning theory directly to automated planning evaluations for language models.
Watch out for
- Documentation does not state the number of tasks, specific file formats, or evaluation metrics.
- Dataset documentation does not detail the specific domains or engineering sub-disciplines included.
Questions
Can I look inside LLM-narrative-planning-taskset without downloading it?
Not here: it declares no licence, so no permission to redistribute its rows has been granted. Its description and statistics are still shown.
What licence is LLM-narrative-planning-taskset under?
Its authors have not declared a licence, which means no permission to reuse or redistribute it has been granted.
What is the primary purpose of this task set?
It is designed to evaluate planning and reasoning in large language models across multi-step design and engineering scenarios.
Which research paper is associated with this dataset?
It is associated with the paper entitled 'Can LLMs Generate Good Stories? Insights and Challenges from a Narrative Planning Perspective'.
Who developed this benchmark?
The task set was created and published by ADSKAILab.
Written from LLM-narrative-planning-taskset's own dataset card. Statements citing a figure that does not appear there are removed before publication. Licence and running details come from our registry.