Nov 2023

Searchable Attributes for JSON logs

As of January 4, 2023, groundcover also supports searchable attributes for logs in Common Log Format (CLF) and logfmt formats. Read more here.

Release Date: November 27, 2023

Affected Sections: Logs

We are excited to announce the addition of Searchable Attributes for JSON logs! This important milestone will make searching and filtering through your logs much easier and faster, as you can now select specific attributes that you want to add to your search query from within the log side panel.

Filter menu options:

• Filter by - Adds the selected attribute to the search query

• Remove - Removes the selected attribute to the search query

• Exclude - Filters out all logs that contain the selected attribute from the search results

• Replace - Removes all active filters and keeps only the selected attribute as the only filter

• Copy to clipboard - Copies the selected attribute to your clipboard for any use, including outside the platform.

The ability to search and filter using attributes can also be done directly from the search bar, by using the following syntax: @key:value

While this new capability is only available for JSON logs at this time, we’re already working on expanding the usage to include attributes for traces too. More on this soon…

These new capabilities are available are available with v1.6.16 or later. Learn how to update groundcover's agent to the most recent version.

v1.6.0: Dashboard and Alert queries made faster and simpler

Release Date: November 8, 2023

Affected Sections: Alerts, Dashboards

We are delighted to share that groundcover version 1.6.0 is now available! This latest release marks a substantial improvement in how you can build queries for your logs and traces using groundcover Dashboards and Alerts, providing enhanced capabilities that are faster and simpler to use. With the introduction of a new schema in the logs and traces tables, you can now leverage attributes and tags to construct more efficient queries, saving you time and enhancing your data analysis.

Changes in the schema

The existing columns flatten_(string/float/bool)_keys & flatten_(string/float/bool)_values are being phased out in favor of new Map-type columns: string_tags & float_tags.

Introduction of new map-type columns

These new columns string_attributes& float_attributes will store attributes for JSON logs, providing a structured and convenient method for easier and faster queries.

Notes:

• The data within the old columns will not transfer to the new schema. The new columns will only contain data from new logs and traces going forward.

• This update impacts only queries you make on the ClickHouse database (either directly or using our Alerts & Dashboards tabs). At this stage, Logs and Traces tabs in the UI will not be affected by this update.

Example Query:

SELECT * FROM logs WHERE string_attributes['error'] = 'failed to get ads: rpc error: code = DeadlineExceeded desc = context deadline exceeded'

How to access these new capabilities:

We recommend all users to upgrade to the latest version to benefit from these improvements. Our support team is available to assist with any questions or guidance needed during this transition.

More coming up soon

We will shortly introduce an in-platform attribute-based search for JSON logs. This upcoming feature will further enhance your querying capabilities using groundcover. Stay tuned for updates on this front!