Contract-Focused Chatbot Response

From GM-RKB
Jump to navigation Jump to search

A Contract-Focused Chatbot Response is a chatbot response generated by a contract-focused chatbot in reply to a contract-focused user request.

  • Context:
    • It can (typically) be aimed at fulfilling the user's request and completing the desired Contract-Focused Task.
    • It can involve natural language generation to formulate the response text.
    • It can contain relevant data, analysis, recommendations, or other contract-related content.
    • It can indicate if the chatbot is unable to fulfill the user's request.
    • It can request clarification from the user if the original request was unclear.
    • It can be simple or complex depending on the user's query.
    • It can (typically) be a part of a Contract-Focused Dialog Turn.
  • Example(s):
    • "Here is a summary of the key terms in the vendor contract: [summary text]"
    • "I'm sorry, I do not have enough information to make a comparison between those contracts. Please provide more details."
    • "The payment terms specified in Section 4.2 of the customer template are net 30 days."
    • "I do not currently have capabilities to draft full contract documents. I can suggest clauses and text snippets."
  • Counter-Example(s):
    • A response about criminal law.
    • A response about financial reporting.
    • A response to schedule a meeting.
  • See: Natural Language Generation, Dialog Management, Conversational Agent, Response Generation.


References

2023

  • Claude 2.
    • QUOTE: Table 1: Analysis of Contract-Focused Chatbot Response Properties
    • Prompt to reproduce:

      "Provide a wiki table categorizing properties of sample contract-focused chatbot responses. Include columns for aspects like: providing requested information, asking clarification questions, indicating system limitations, generating text, providing options/alternatives, analyzing contract(s), referencing knowledge bases, and using external data sources. Provide a diverse set of sample chatbot response examples and mark which properties apply for each."

Contract-Focused Chatbot Response Provides Requested Information Requests Clarification Indicates Limitation Generates Text Provides Options Analyzes Contract(s) References Knowledge Base Uses External Data Unrelated Question
"Here are the payment terms per your request: Net 30 days." X
"Can you clarify which version of the NDA template you need? V1.2 or V2.0?" X
"I do not have capabilities yet to make comparisons across multiple contracts." X
"Here is a draft amendment extending the contract term by 1 year: [text]" X
"For this contract renewal, I can generate Option A based on the prior terms or Option B with the proposed new terms." X
"This contract complies with 234 of the 256 procurement guidelines based on my analysis." X
"The NDA template from the master contract database has been populated with the requested client information." X
"The average liability cap based on the Insurance Services dataset is $2M for this industry." X
"Your query does not seem related to contracts." X
  • Table 2: Sample Contract Chatbot Responses Indicating System Limitations
    • Prompt to reproduce:

      "Provide sample contract-focused chatbot responses that indicate various system limitations and gaps in capabilities. Include a diverse set of limitations like inability to compare contracts, give legal advice, access proprietary data, insufficient knowledge in certain contract domains, or answer unrelated questions. Format as a wiki table with a column for the chatbot response text and a column indicting it specifies a limitation."

Contract-Focused Chatbot Response Indicates Limitation
"I'm sorry, I don't have capabilities yet to compare multiple contracts or their clauses." X
"I cannot provide legal advice or interpretations per my system limitations." X
"I do not have access to your company's proprietary contract playbooks to assess compliance." X
"My training data does not cover government procurement contracts to answer your specific question." X
"Unfortunately I do not yet have the functionality required to provide an adequate response to your question." X
  • Table 3: Analysis of Contract Chatbot Request Types
    • Prompt to reproduce:

      "Provide a table analyzing different types of contract-focused user requests to a chatbot. Include rows for request types like: summarizing contract changes, drafting explanations, comparing to templates, searching clauses, drafting messages, answering questions, populating data, legal research. And columns indicating properties of the chatbot's response like: providing requested info, generating text, analyzing contracts, referencing knowledge bases, using external data. Fill in the table to show which properties apply for each request type."

Request Type Provides Requested Info Generates Text Analyzes Contract(s) References Knowledge Base Uses External Data
Summarizing contract edits and changes X X
Drafting explanatory comments for contract changes X X X
Comparing contract clauses to templates and playbooks X X X
Searching for similar clauses across documents X X
Drafting emails/messages with contract details X X
Free-form questions about contracts (AMA-style) X X X X
Auto-populating contract entities and terms X X X
Legal research queries X X X