Search results aggregations
In version 4.0 and later, Code Insights provides aggregations shown on the search screen.
This lets you track version and license spread, library adoption, common commit messages, lengths of specific files, usage frequencies, and the many common use case examples here.
You can aggregate any search by:
- The repositories with search results
- The files with search results (for non-commit and non-diff searches)
- The authors who created the search results (for commit and diff searches)
- All found matches for the first capture group pattern (for regexp searches with a capture group)
Aggregations are returned in order of greatest to least results count.
Aggregations are exhaustive across all repositories the user running the search has access to, unless the chart notes otherwise (see Limitations below).
We may continue adding new aggregation categories, like date and code host, based on feedback. If there are categories you'd like to see, please let us know.
You can turn the aggregations on with the experimental feature setting:
searchResultsAggregations in your user, org, or site settings.
You can turn off just the proactive aggregations by setting
This prevents aggregations from running on every search and requires users to explicitly click to run them.
(The main reason to consider disabling proactive aggregations is if you're seeing a heavy or unexpected load on your instance, but as noted below in Limitations there are limits that keep the overall resource needs low to begin with.)
You can drilldown into a search aggregation by clicking a result in the chart. Your original search query will be updated with a
author filter or a regexp pattern depending on the aggregation mode.
If you attempt to run a query for which a given mode is not supported, the tooltip will inform you why that mode is not available.
At the moment all aggregations search queries are run with a 2-second timeout, even if your search specified a timeout. If the aggregation times out, you will be able to trigger a longer search with a 1-minute timeout by clicking
Run aggregation. The extended timeout can be configured by changing the number of seconds in global settings
insights.aggregations.extendedTimeout. If configuring this to greater than 60 seconds please see More information on timeouts.
After adding new repositories it can be common for aggregations to experience timeouts while those repositories await initial indexing. This is due to aggregations running exhaustive searches over all repositories and will resolve once that indexing is complete.
Aggregation search queries that run proactively are run with
count:50000. This default can be changed using the site setting
If the number of results exceeds this limit, the user can choose to explicitly run the aggregation, and these explicitly-run aggregations use
Best effort aggregation
Results are aggregated in a best-effort approach using a limited-size buffer to hold group labels in order not to strain the webapp when these aggregations are run. This means that in some cases we might miss some high-count results. Aggregations that hit such non-exhaustive paths are reported back to the user.
You can control the size of the buffer using the site setting
insights.aggregations.bufferSize. It is set to 500 by default. Note that if increasing this you might notice decreased performance on your instance.
Number of bars displayed
The side panel will display a maximum of 10 bars. If expanded, a maximum of 30 bars will be displayed. If there are more results this will be displayed on the panel.
Single capture group
Aggregations by capture group will match on the first capture group in the search query only. For example, for a query:
and a match like
beautiful will be shown as a result.
Files with the same paths in distinct repositories
The "file" aggregation groups only by path, not by repository, meaning files with the same path but from different repos will be grouped together. Attach a
repo: filter to your search to focus on a specific repo.
Saving aggregations to a code insights dashboard
Saving aggregations to a dashboard of code insights is not yet available.
Slower diff and commit queries
Running aggregations by author is only allowed for
type:commit queries, which are likely not to complete within a 2-second timeout.
You can trigger an explicit search with an extended 1-minute timeout, or you can limit your query using a single-repo filter (like
repo:^github\.com/sourcegraph/sourcegraph$) combined with a
Aggregations for structural searches are unlikely to complete within a 2-second timeout. You can try to trigger an explicit aggregation for such cases.
Standard searches with embedded regexp
Standard searches with embedded regexp such as below do not support aggregation by capture group. This is because they are functionally similar to a query with an