Telemetry

Overview

The term telemetry refers to the collection of certain usage data to help improve the quality of a piece of software. Dendron uses telemetry primarily for collecting usage data.

This page describes the overall telemetry approach for Dendron, what kind of data is collected and how to opt-out of data collection.

Why does Dendron collect metrics?

Telemetry helps us better understand how many users are using our products and how often they are using our products.

We use telemetry to answer the following questions:

  • how many people are actively using Dendron?
  • how performant is Dendron over time and how do new changes impact performance?
  • what features are most useful for users?
  • what exceptions and errors are users encountering?

What is not collected

Dendron will never collect data inside your notes. We believe that your personal knowledge is for your eyes alone.

What is collected

  • Events Collected

  • Event Properties Collected

  • NOTE: we are currently in the process of migrating events from this page to the airtable. this is why you might see some events on this page that are not on the airtable

When is data collected?

Data is collected in scenarios that are described below.

Startup

When Dendron initializes, we collect data about on initialization time. This helps us measure the performance impact of changes that run before startup as well as improvements to our indexing performance over time. In addition to the above field, we track the result of configuration migrations. This helps us make sure deprecating old configurations and introducing new configurations work seamlessly.

CLI_Client_Config_Mismatch

When a configuration or client version does not meet the minimum compatibility requirement, we track the mismatch. This helps us make sure migrations are ran successfully and understand ways to prevent users from running into compatibility issues.

FieldAttributesDescription
reason"client"|"config"Reason for mismatch
clientVersionstringClient version when the mismatch happened
configVersionstringConfig version when the mismatch happened
minCompatClientVersionstringMinimum compatible client version when mismatch happened
minCompatConfigVersionstringMinimum compatible config version when mismatch happened

Duplicate configuration key

During activation, if there is a duplicate key mapping in dendron.yml, we prompt users that they should remove the duplicate mappings. When doing so, we track that we have prompted, and also track if the user has accepted or rejected the prompt. This helps us understand how users troubleshoot configuration errors and let us improve the way we present instructions.

Missing configuration

During upgrade, if there is a missing configuration key in dendron.yml, we prompt users if they want to fill the missing configuration with a default value. When doing so, we track that we have prompted, and also track if the user has accepted or rejected the prompt. This helps us identify pain points with faulty configurations and understand ways to improve the troubleshooting process.

Incompatible extensions

When we detect that a user has extensions that incompatible with Dendron's capabilities, we warn the user on startup that they may cause problems. We track which extensions were warned to the user, and also whether they have been redirected to an instruction on how to resolve the conflict. This helps us make Dendron more compatible with existing third party extensions in the marketplace.

Keybinding conflicts

When we detect that a user has an extension that has keybindings that are known to conflict with Dendron's default keybindings, we warn the users and give guidance on how to resolve them. When Dendron is first installed, a user will be prompted with a warning message if keybinding conflicts are detected. We track if the user accepted the message and proceeded with conflict resolution. After initial installation, this feature is available as a doctor command fixKeybindingConflicts. In both initial install and every doctor command execution, we track if keybinding conflicts were detected.

Tutorial Progression

When Dendron starts for the first time, it launches users into a tutorial workflow. We track how far along the tutorial you get using the Tutorial_{num}_Show event. This helps us figure out how effective our intro documentation is.

User Survey

We ask users if they want to answer survey questions that would help use improve Dendron. These surveys are prompted when the user first initializes the tutorial, or has been inactive for two weeks after actively using Dendron on their first week, or has never initialized a workspace after install. To determine inactivity, we track specific points of time when a notable event happens.

We use the results to customize the onboarding experience and help users get started. We track if the user accepted the prompt, and what answer they gave for the survey. For each survey question, the following fields are collected.

FieldAttributesDescription
resultsstring[]List of selected survey answers
otherotherUser submitted answer when they selected other
firstInstallnumbertimestamp of first install event
firstWsInitializenumbertimestamp of first workspace initialization
lapsedUserMsgSendTimenumbertimestamp of last lapsed user message
inactiveUserMsgSendTimenumbertimestamp of last inactive user message
dendronWorkspaceActivatednumbertimestamp of last workspace activation
firstLookupTimenumbertimestamp of first lookup accept
lastLookupTimenumbertimestamp of last lookup accept

Installation/Upgrade/Uninstall

When Dendron is first installed or upgraded, we collect information about both previous and current versions. This helps us plan deprecation policies.

FieldAttributesDescription
previousVersionstringPrevious version of Dendron
durationnumberNumber of seconds for startup

Lookup

When lookup is performed, Dendron collects profiling information for different phases of lookup. This helps us measure the performance impact of optimizations and features we add to lookup.

Events

  • Lookup Show: when lookup is presented
  • Lookup Update: when lookup items are updated
  • Lookup Accept: when a result from lookup is accepted
FieldAttributesDescription
flavorstringWhat kind of lookup ("schema" or "note")
errorbooleanDid an error happen during this phase?
sourcestringWhat initiated the lookup? ("onValueChange", "updatePickerBehavior:journal", etc.)
createNewNotebooleanWas a new note created during this phase?

Commands

We collect an invocation metric when a commands is invoked. This is to measure command latency as well as detect errors in existing and new commands

FieldAttributesDescription
errorbooleanDid an error happen during this phase?
durationnumberHow long did it take to execute this command

Lookup commands

For commands that utilize the core lookup module, we additionally collect the state of the lookup modifiers when the user accepts as well as on manual button triggers.

FieldAttributesDescription
commandstringWhat is the invoked command?
typestringWhat button was toggled?
pressedbooleanWhat is the state of the button after toggle?

For the Copy Note Link command, we also collect some information to understand where it is used the most.

FieldAttributesDescription
typestringWhat type of file was this, a note or non-note?
anchorTypestringIf an anchor was created, what type was it? Block, header, or line?

Doctor

For the Doctor command, we also collect what doctor action was performed and at what scope.

FieldAttributesDescription
actionstringName of the doctor action if one was performed, like "fixFrontMatter".
scopestringThe scope of the action, either "workspace" or "file".

Workspace Sync

To understand how users take advantage of our synchronization features, we also collect the following data if the Workspace Sync command is used.

FieldAttributesDescription
hasMultiVaultRepobooleanTrue if there was a repo that had multiple vaults in it, false otherwise.

Copy To Clipboard

Copy To Clipboard is a command that could only be invoked by clicking on a Markdown Link in a VSCode Webview. We use this as a simple way to simulate a copy button within a rendered markdown preview. We track the source of this command's invocation to better understand the user experience of markdown based webviews.

FieldAttributesDescription
sourcestringName of the webview that this command was invoked.

Show Note Graph

To understand how the users take advantage of our graph view feature, we also collect the following data if Show Note Graph command is used.

FieldAttributesDescription
timeOpennumberThe duration for which Note Graph was used.
messagestringWas the graph view used for navigation?

CLI commands

We collect an invocation metric when a CLI command is invoked. This is to measure command latency. We also collect command arguments that do not contain user-identifying information to analyze usage frequency of a particular command argument

FieldAttributesDescription
durationnumberHow long did it take to execute this command
argsobjectWhat arguments were passed to the command (user-identifying properties omitted)

CLI command arguments

This is an exhaustive list of CLI command arguments collected on invocation.

CommandFieldAttributesDescription
devcmdstringWhat dev command was used (e.g. run_migration, build)
doctoractionstringWhat doctor action was used (e.g. fixFrontmatter, h1ToH2)
importPodpodIdstringWhat pod was used (e.g. dendron.json, markdown)
exportPodpodIdstringWhat pod was used (e.g. dendron.json, markdown)
publishPodpodIdstringWhat pod was used (e.g. dendron.json, markdown)
notecmdstringWhat note command was used (e.g. lookup, delete)
noteoutputstringWhat output format was used (e.g. json, md_gfm, md_dendron)
publishcmdstringWhat publish command was used (e.g. init, build)
seedcmdstringWhat seed command was used (e.g. init, add)
seedidstringWhat seed id was used
seedmodestringWhat seed mode was used (e.g. create_workspace, convert_workspace)
vaultcmdstringWhat vault command was used (e.g. create)
workspaceactionstringWhat workspace action was used (e.g. init, push, pull)

Contextual UI

We collect an invocation metric when a commands is invoked through Contextual UI. This helps us to measure the visibility and effectiveness of Contextual UI.

Errors

Whenever a crash happens or an unexpected error, we collect information surrounding the error to help us diagnose the problem and fix it. For more information, see Error Reporting (Private).

FieldAttributesDescription
ctxnumberWhat happened right before the error occurred?
messagestringThe error message itself
payloadstringPayload with diagnostics information such as exception call stacks, exception severity, and HTTP error codes.

Other

These are groupings of other metrics we collect. We collect them to gather performance impact and improvements across various features.

Events

FieldAttributesDescription
durationnumberHow long it takes for the tree view to be initialized

Telemetry Toggle

When telemetry is disabled or enabled, we collect information about the event to let us get an estimate of the number of untracked clients

FieldAttributesDescription
reasonenumWhy telemetry was disabled. See values here

How to opt out of data collection

To disable telemetry in Dendron specifically, run the Disable Telemetry command. You can also disable telemetry using the cli by using the disable_telemetry command.

Why not have opt-in telemetry?

The goal of telemetry is to make data driven decisions about features and use cases that can make the most difference to our users.

One way we could collect data is to conduct surveys but traditionally, these had very low participation and are also biased towards users that are already active in our community. Having telemetry allows us to collect feedback from our larger user base and avoids this bias.

Opt-in telemetry, at best, gives us a narrow and biased set of users. At this point, we are back to make decisions based on limited data. Opt-out telemetry that is limited in scope is the tradeoff we made in terms of preserving user privacy while still gathering meaningful data that can help improve the product.


Backlinks