Awarity is introducing a groundbreaking service that enhances how large language models (LLMs) reason over extensive sets of private data.
We recorded this video to provide an early glimpse into the product’s capabilities. It showcases Awarity’s ability to analyze a due diligence folder containing 71 diverse documents, including Word docs, Excel files, PDFs, and PowerPoint decks. These documents mirror typical contents of a diligence folder, such as cap tables, voter rights agreements, board minutes, and confidentiality agreements.
Revolutionizing Data Ingestion with the Elastic Context Window
Awarity’s innovative approach begins with the ingestion of documents into its Elastic Context Window (ECW). This cutting-edge feature enables Awarity to tackle reasoning tasks that go far beyond the conventional limits of LLMs, such as GPT’s current 128,000-token limit. The folder featured in the video contains about 21 Megs of data, requiring approximately 5 million tokens for thorough reasoning.
A Unique Approach to Complex Reasoning
The video highlights Awarity’s ability to handle complex queries, such as answering questions a VC might have regarding shareholder rights and patents. For instance, finding and reviewing all documents related to shareholder rights, intellectual property, and product descriptions could involve parsing a 60-page Series A Preferred Stock Purchase Agreement. Awarity uses a distinctive prompting technique to distribute reasoning across multiple model calls, enabling it to analyze all documents in their entirety without needing model training or a retrieval-augmented generation (RAG) process. This method eliminates data loss or omissions, effectively solving the “lost in the middle” problem faced by other solutions.
Benchmarking and Accessibility
Awarity’s capabilities have been rigorously tested in a reasoning exercise involving over 110 million tokens in the context window. Impressively, Awarity can run on standard hardware. For example, the 110-million-token text test used Llama 3/8b on an $8,000 PC. While our beta versions use a public cloud for demonstrations, Awarity is designed to operate on a private cloud or on-premises, ensuring superior data security.
This video underscores Awarity’s transformative potential for data reasoning tasks, offering a fresh perspective on data processing. Viewers intrigued by Awarity’s capabilities are invited to explore personalized sessions tailored to their unique data needs by clicking here.