Hatched January 19, 2024
What is Helios?
Helios is the Luminoso Daylight Assistant, powered by Claude.
What does Helios do?
Helios explores the Galaxy, guided by Daylight as he helps Luminoso customers with summaries, descriptions, key insights, and more.
Where can I find Helios?
Nestled in the chat at the bottom right corner of Luminoso’s Daylight Application, click on Helios to open the chat interface and ask him any question you’d like.
Get high-level summaries, dive into specific topics, and more:
Helios is also available in the Concept Lists menu with the “Add with Helios” button. This creates a set of labels for general themes that surfaced in your project, as well as individual deep dive lists for each of those themes.
Dashboard Summary widgets
Does Helios use my data to train other Large Language Models?
No. Helios keeps your data private.
Helios does not store your data, nor is the data provided to Helios used to train any large language models.
Claude is a large language model developed by Anthropic. Amazon Bedrock is a cloud-based service from AWS that allows developers to access and use various foundation models, including Claude. In essence, Bedrock is a platform, and Claude is one of the models available on that platform. See the Bedrock FAQ page here.
Amazon Bedrock prioritizes data security and privacy for its clients using a multi-layered approach. Here are some key ways it guarantees data security:
- Data Isolation and Encryption:
Customer data is not used to train or improve base models: Customer inputs and outputs are not used for training AWS’s own models or shared with third-party model providers.
Encrypted in transit and at rest: Data used by Bedrock is encrypted while it’s being transmitted (in transit) using TLS 1.2 or higher, and also when it’s stored (at rest) using AWS Key Management Service (KMS). - Secure Connectivity and Access Control:
You can establish private network connections from your Amazon Virtual Private Cloud (VPC) to Amazon Bedrock using AWS PrivateLink, keeping your data traffic off the public internet.
AWS Identity and Access Management (IAM) allows you to define policies to restrict who can invoke specific models or access specific Bedrock resources. - Compliance and Responsible AI:
Amazon Bedrock supports common compliance standards like SOC, ISO, HIPAA, and GDPR.
Amazon Bedrock Guardrails help you implement safeguards for your generative AI applications. - Logging and Auditing:
Integrations with Amazon CloudWatch and AWS CloudTrail provide detailed logs for monitoring and auditing.
You can enable logging of model inputs and outputs for auditing. (We are currently not doing this)
In summary, Amazon Bedrock provides a secure environment for using LLMs through data isolation, encryption, access control, compliance, and responsible AI features. Remember, security is a shared responsibility, and you should follow AWS best practices for your specific use case.
My organization uses our own LLM, can I use that to power Helios?
Yes. Contact your Luminoso success or account manager to discuss getting this set up. Once setup is complete, users may go to the Helios Backend from the Project Management page and “Change to CUSTOM”
How does Helios prevent responding with AI hallucinations, otherwise explained as providing false or misleading information?
The current version of the Helios Chatbot is a RAG (Retrieval Augment Generation) pipeline. By its design, RAGs are not prone to hallucinations.
The model responds to the customer query based on the context obtained during the Information Retrieval step of the pipeline. The Retrieval step doesn’t involve any genAI. It is a search through the dataset based on the query.
The model gets the query together with the result of the Retrieval step (a.k.a context) and generate the answer exclusively based on the context being provided. Hence, this step is called the Augmented Generation. This behavior is further reinforced by the system prompt explicitly instructing the model to only use the context to answer the query.