<img height="1" width="1" style="display:none" src="https://www.facebook.com/tr?id=1003172278004933&amp;ev=PageView&amp;noscript=1">

Inside the Quid Factory

The Quid Factory is the core of Quid's technology offering. It integrates the Data layer, the Tooling layer, and the Agent layer, providing a dynamic assembly line that produces user-focused contextual insights. 

Quid-Factory-Final

Data Layer

From social, market, search and even your own data, Quid delivers you actionable insights that help you drive positive business outcomes by drawing connections from millions of diverse data sets. Today, we have over 2 petabytes of model data active for our customers. 

Quid operates a diverse array of data connectors and downloaders that connect to various data sources, including Reddit, Facebook, Instagram, YouTube, LexisNexis news, X/Twitter, Weibo, S&P Capital IQ company data, Crunchbase company data, Clarivate patent data, as well as news, blogs, reviews, and forum sites. These data connectors utilize a mix of streaming endpoints, RESTful APIs, and other data protocols for file transfers. Every day, we receive and store over 300 million documents, maintaining a live archive with access to trillions of records. 
Each document arriving at our facility is processed by a cluster of hundreds of machines operating under a proprietary, in-house-built MapReduce framework. Junk and spam content are filtered out in the early stages, and the remaining documents are normalized, indexed, and integrated into a searchable document store powered by inverted indexes, RDBMS, graph databases, and vector databases. The entire pipeline is designed to ensure high availability and seamless horizontal scalability. 
Quid’s data processing pipeline incorporates advanced Generative AI and NLP models for data enrichment. These models support over 40 languages and perform tasks such as geographic tagging down to the city and DMA levels, sentiment and emotion analysis at the sentence level, and social mood assessment. Additionally, the models recognize named entities, identify demographic and gender profiles, and perform other sophisticated analyses.
Data accessibility at Quid adheres to the same horizontal scalability principles, distributing searchable document stores across hundreds of servers. To maximize system availability, we implement replication and automatic failover mechanisms. Our query cluster extends beyond basic text search, providing flexible solutions tailored to diverse problem domains. This includes semantic search and structured search with Boolean operators, wildcard matching, word proximity searches, time-series analysis at various time intervals, histograms, distinct value counts, and more. 

Tooling Layer

Quid has developed a suite of tools, including Discover, Monitor, Compete, Connect, and Quid AI, to empower users with actionable insights. These tools facilitate the generation of topics, themes, data networks, database tables, data warehouse instances, interactive conversational sessions, insightful reports, and dashboards. Together, they help users analyze relevant data and take meaningful actions based on contextual insights. 

QUID_Discover_Main_Logo

Quid Monitor leverages extensive consumer and market intelligence data to help users track brand health, analyze customer sentiment, and refine campaigns. It enables the identification of social advocates and detractors, validates product ideas through market exploration, detects potential crises, and provides insights to guide marketing and product strategies. By enhancing audience understanding, it supports efforts to improve customer loyalty, boost brand reputation, and drive growth. 

 

QUID_Monitor_Main_Logo-1

Quid Monitor leverages extensive consumer and market intelligence data to help users track brand health, analyze customer sentiment, and refine campaigns. It enables the identification of social advocates and detractors, validates product ideas through market exploration, detects potential crises, and provides insights to guide marketing and product strategies. By enhancing audience understanding, it supports efforts to improve customer loyalty, boost brand reputation, and drive growth. 

 

QUID_Compete_Main_Logo (1)

Quid Compete offers a clear, panoramic view of the digital impact of users’ social media and content marketing strategies. By comparing performance and market position with competitors, users can identify effective tactics and areas for optimization. 

 

QUID_Connect_Main_Logo-1

Quid Connect provides a robust relational database solution, giving users direct access to real-time, consolidated data from millions of sources, including consumer, news, and market data. It supports advanced analytics, querying, and custom metrics, while enabling users to blend internal data with Quid data for enhanced insights. 

 

Quid_AI

Quid AI leverages advanced large language models (LLMs) and cutting-edge technologies to deliver powerful AI-driven capabilities. 

SUPPORTED LLMS

Quid supports a variety of LLMs, including Llama 3-8b, Zephyr-7b-beta, Mistral-8x7b, Mistral-7b, OpenAI-o1, and Anthropic Claude 3.5. The system is designed with heterogeneity in mind, maintaining compatibility across tools to allow Quid engineers to seamlessly switch between commercial and in-house LLMs for both prototyping and production deployment. 

INFERENCE ENGINE

Quid has developed an in-house adaptive system that dynamically selects between vLLM and TGI inference engines, depending on the task's requirements. The system also allows for dynamic provisioning that scales inference nodes across multiple cloud regions to maximize availability and cost efficiency. 

QUANTIZATION TECHNIQUES

Quid employs GPTQ with Marlin kernel for quantization, optimizing inference speed without compromising accuracy. 

FINE TUNING

Quid utilizes the PEFT library and QLoRA to achieve performance comparable to fully fine-tuned models, with reduced computational costs and VRAM usage. 

APPLICATION OF LLMS

Quid AI applies LLMs across various use cases, including: 

  • Entity Extraction: Identifying key entities such as names, organizations, and locations in text. 
  • Text Summarization: Condensing documents into concise, informative summaries. 
  • Topic Clustering: Grouping related content for thematic analysis. 
  • Semantic Search: Enhancing search capabilities with context-aware retrieval. 

Agent Layer

Quid AI-powered agents leverage the Quid product suite from the tooling layer and perform data analysis utilizing the data layer. The availability of tools and seamless access to a variety of enriched datasets enhance interoperability between tools and data, providing a cohesive and efficient user experience. Quid has developed two types of agents: Workflow Agents and Conversational Agents. 

WORKFLOW AGENTS

Workflow_Agents

Workflow Agents are configured with specific arguments and executed within the Quid computing environment for specialized tasks. Users define how workflows are executed by filling out configurations, which include workflow arguments and scheduling requirements. Each configuration operates independently. 

CONVERSATIONAL AGENT

Customers - Heart of Data - Gradient - 1200x1200 (2)-1-1

The Conversational Agent, Ask Q, is a Generative AI-driven chat solution designed to make data insights more accessible. Built for both novice and advanced users, Ask Q employs topic-adaptive retrieval-augmented generation (RAG) to deliver accurate, hallucination-free responses. Its interactive conversational interface offers transparency in query processes, allowing users to understand and trust the insights it provides. 

QUID

Q, our AI-Agent operates through prompts on the models we build in your environment. Q helps business users find fast actionable insights across vast consumer and market models that drive measurable outcomes. Q is your best merchandiser and your brand advocate. Q works while you sleep to power your success.

Context Composer

A flexible, free-form workspace for organizing and publishing insights as customizable context briefs. The Context Composer is where our Analytical Engineers build the insights that gets published to the Quid Terminal.

Context_Composer

WORKSPACE SETUP (FREE-FORM CANVAS)

Provides a flexible workspace for assembling and customizing data insights, notes, and templates.

DATA CONFIGURATION BY INTERNAL USERS

Allows internal users to configure data sources, filters, and prompt templates tailored to use cases.

PRE-DEFINED WORKFLOWS WITH CUSTOMIZABLE TEMPLATES

Supports commonly-used workflows with visualizations and prompts for various briefs. 

"ASK QUID" FEATURE WITH FEEDBACK LOOP

Integrated chatbot allows users to ask questions and request insights. Feedback loop refines answers over time. 

PUBLISHING AND SHARING

Provides multiple options to publish, export, or share content externally. 

Engineering

At Quid, our engineering expertise spans software, data, analytical, and model engineering—all working in harmony to equip clients with actionable insights that drive impactful outcomes. By combining software, data, models, and analytics, we interpret complex datasets and deliver clarity through effective partnerships.

Customers are welcome to collaborate with our analysts—but it’s not a requirement. Whether you engage hands-on or rely on our experts, we ensure insights are not just understood but applied to achieve measurable results.

Software Engineers

Design, develop, and maintain scalable tools and infrastructure capable of processing and analyzing billions of data points efficiently. These systems enable the seamless extraction of insights from vast datasets, supporting advanced analytics and empowering businesses with actionable insights.

Software-Engineers