Master Index Hub Overview
Welcome to the Convoluted Organization™ Enterprise Reference Hub. Below are all 38 integrated infrastructure platforms, fully color-coded by category type, expanding each reference table to 200 exhaustive administrative commands with a verbose technical summary header.
Microsoft Purview Gov
Unified data governance, lineage tracking, and automated asset scanning.
Collibra Governance Gov
REST API and administrative reference matrix for Collibra governance.
Alation Catalog Sync Gov
Metadata extraction, stewardship metrics, and bulk sync matrix.
PostgreSQL OLTP
Core transactional engine parameters, extensions, and CLI maintenance.
MySQL Enterprise OLTP
InnoDB configurations, replication setups, and operational commands.
SQL Server T-SQL OLTP
Administrative, diagnostic, and maintenance script matrix for T-SQL.
Oracle Database OLTP
SQL*Plus, RMAN operations, and tablespace management matrix.
IBM Db2 z/OS OLTP
TSO/ISPF console commands and subsystem operations matrix.
MariaDB OLTP
Aria/InnoDB storage engine and administrative CLI matrix.
SQLite OLTP
Lightweight CLI, PRAGMA configuration, and administrative matrix.
CockroachDB OLTP
Distributed SQL, multi-node ranges, and cluster management.
PingCAP TiDB OLTP
Distributed HTAP, Placement Driver, and TiUP operational matrix.
Amazon Aurora OLTP
AWS CLI, RDS parameter groups, and managed cluster operations.
Snowflake Data Cloud OLAP
Virtual warehouse sizing, RBAC, time travel, and stream-tasks.
Google BigQuery OLAP
Serverless data warehouse bq CLI and analytics SQL matrix.
Amazon Redshift OLAP
AWS CLI and SQL administrative columnar warehouse matrix.
ClickHouse Analytics OLAP
MergeTree columnar engine and high-speed analytical queries.
Databricks Unity OLAP
Unity catalog governance, Delta Lake optimization, and Spark SQL.
Apache Druid OLAP
Real-time analytical time-series and ingestion supervisors.
DuckDB OLAP
Embedded vectorized analytical processing and cloud extension CLI.
Trino (Presto) OLAP
Federated distributed SQL querying across multi-source catalogs.
Apache Hive OLAP
Beeline CLI, Metastore catalog, and HiveQL operational matrix.
Apache Iceberg OLAP
Open table format snapshot history, compaction, and maintenance.
MongoDB Enterprise NOSQL
Document-oriented database, replica sets, and aggregations.
Apache Cassandra NOSQL
Wide-column distributed cqlsh CLI and nodetool maintenance.
Apache HBase NOSQL
Hadoop column family database shell and cluster administration.
CouchDB NOSQL
Document store REST API, view indexing, and Couch replication.
Amazon DynamoDB NOSQL
Serverless NoSQL key-value store AWS CLI administration.
Redis Enterprise NOSQL
In-memory data structure store, caching, and streams matrix.
Memcached NOSQL
Distributed memory object caching server management matrix.
Apache Flink Stream
Stateful stream processing and real-time pipeline management.
Apache Kafka Events Stream
Distributed event streams, topics, and consumer groups.
InfluxDB Stream
Time-series database metrics, Flux queries, and buckets matrix.
Neo4j Graph GRAPH
Connected data traversal, Cypher querying, and graph algorithms.
Amazon Neptune Graph GRAPH
Managed graph cluster, Gremlin traversal, and SPARQL matrix.
Milvus Vector DB VECTOR
High-performance vector similarity search and index management.
Qdrant Vector DB VECTOR
Vector database similarity search, payload filters, and snapshots.
Pinecone Vector Index VECTOR
Managed vector index serverless SDK and namespace operations.
Microsoft Purview Gov
Technical Architecture & Overview
Microsoft Purview is an enterprise-grade, unified data governance and compliance solution designed to manage and govern data across on-premises, multi-cloud (Azure, AWS, GCP), and SaaS environments. Built on an open Apache Atlas metadata framework, Purview automatically scans, classifies, and maps data assets to construct an end-to-end data map and automated lineage graph.
Primary Use Cases: Automated data discovery, PII/PHI sensitive data classification, automated data lineage tracking for ETL/ELT pipelines (Data Factory, Synapse, Databricks), business glossary management, and fine-grained attribute-based access control (ABAC) policies across distributed enterprise storage.
Core Components: Data Map (Atlas-compatible graph engine), Data Catalog (search, business glossary, asset curation), Data Insights (operational telemetry, classification coverage, sensitivity label distributions), and Policy Store (access policies and consent enforcement).
Exhaustive 200-command administrative, diagnostic, and operational matrix for Microsoft Purview.
| # | Operation / Action | API / PowerShell Syntax | Description |
|---|---|---|---|
| 1 | Get Account Info | Get-AzPurviewAccount -Name 'org-purview' | Retrieves Purview account metadata. |
| 2 | New Scan Rule | New-AzPurviewScanRule -Endpoint https://org-purview.scan.purview.azure.com | Defines custom classification rules. |
| 3 | Trigger Data Scan | Start-AzPurviewScan -ScanName 'SqlScan' -ResourceGroupName 'rg-data' | Initiates source metadata extraction. |
| 4 | List Classifications | Get-AzPurviewClassificationRule | Outputs built-in/custom classifiers. |
| 5 | Get Asset Lineage | GET /catalog/api/atlas/v2/lineage/{guid} | Extracts end-to-end data provenance. |
| 6 | Search Catalog Assets | POST /catalog/api/search/query | Executes full-text asset search. |
| 7 | Create Glossary Term | POST /catalog/api/glossary/terms | Adds a governance business term. |
| 8 | List Collections | GET /account/api/collections | Retrieves hierarchical collection nodes. |
| 9 | Assign Collection Role | POST /account/api/collections/{name}/roleAssignments | Delegates security roles. |
| 10 | Get Scan Status | Get-AzPurviewScanStatus -ScanId 'scan-123' | Inspects active scan progress. |
| 11 | Delete Asset Record | DELETE /catalog/api/atlas/v2/entity/guid/{guid} | Purges metadata entity from catalog. |
| 12 | Create DataSource | PUT /scan/api/datasources/{dataSourceName} | Registers a new target data source. |
| 13 | List Data Sources | GET /scan/api/datasources | Lists all registered data sources. |
| 14 | Get Classification Rules | GET /scan/api/classificationrules | Fetches all active scanning rules. |
| 15 | Trigger Bulk Classification | POST /catalog/api/discovery/classify | Runs batch asset classification. |
| 16 | Export Sensitivity Labels | Get-AzPurviewSensitivityLabel | Outputs applied sensitivity tags. |
| 17 | Create Policy Assignment | POST /policy/api/assignments | Applies attribute-based access policy. |
| 18 | Get Insight Metrics | GET /insights/api/asset/count | Retrieves asset catalog volume counts. |
| 19 | Set Managed Endpoint | Set-AzPurviewManagedPrivateEndpoint | Configures secure network peering. |
| 20 | Get Insights Scans | GET /insights/api/scan/status | Fetches operational scan analytics. |
| 21 | List Custom Attributes | GET /catalog/api/types/typedefs?type=entity | Inspects metadata schema definitions. |
| 22 | Create Business Metadata | POST /catalog/api/types/typedefs | Adds custom metadata attributes. |
| 23 | Get Credential Reference | Get-AzPurviewCredential | Retrieves secure connector key mapping. |
| 24 | Create Credential | New-AzPurviewCredential -Name 'SQLAuth' | Provisions a new scanning credential. |
| 25 | Get Kafka Notification | GET /notifications/api/events | Retrieves event stream hooks. |
| 26 | Update Glossary Term | PUT /catalog/api/glossary/terms/{guid} | Modifies business definition tags. |
| 27 | Get Policy Status | GET /policy/api/status | Verifies data plane policy deployment. |
| 28 | List Kerberos Configurations | GET /scan/api/kerberos | Inspects local enterprise auth setups. |
| 29 | Test Data Source Connectivity | POST /scan/api/datasources/{name}/testConnect | Validates source reachability. |
| 30 | Remove Purview Account | Remove-AzPurviewAccount -Name 'org-purview' | Decommissions the Purview service. |
| 31 | Get Entity by GUID | GET /catalog/api/atlas/v2/entity/guid/{guid} | Fetches details of a specific metadata entity. |
| 32 | Bulk Create Entities | POST /catalog/api/atlas/v2/entity/bulk | Creates multiple metadata entities in one payload. |
| 33 | Bulk Update Entities | POST /catalog/api/atlas/v2/entity/bulk | Updates multiple entity properties simultaneously. |
| 34 | Delete Entity by Unique Attribute | DELETE /catalog/api/atlas/v2/entity/uniqueAttribute/type/{typeName} | Deletes an entity based on a unique attribute. |
| 35 | Get Glossary by GUID | GET /catalog/api/glossary/{glossaryGuid} | Retrieves a business glossary by its unique GUID. |
| 36 | Create New Glossary | POST /catalog/api/glossary | Establishes a new top-level business glossary. |
| 37 | Delete Glossary | DELETE /catalog/api/glossary/{glossaryGuid} | Removes a business glossary and its terms. |
| 38 | Get Term by GUID | GET /catalog/api/glossary/term/{termGuid} | Fetches detailed metadata for a glossary term. |
| 39 | Import Glossary Terms | POST /catalog/api/glossary/{glossaryGuid}/terms/import | Bulk imports business terms from CSV. |
| 40 | Export Glossary Terms | POST /catalog/api/glossary/{glossaryGuid}/terms/export | Exports business terms to downloadable CSV. |
| 41 | Get Term Assigned Entities | GET /catalog/api/glossary/terms/{termGuid}/assignedEntities | Lists all catalog assets assigned to a term. |
| 42 | Assign Term to Entity | POST /catalog/api/glossary/terms/{termGuid}/assignedEntities | Links a business term to catalog assets. |
| 43 | Disassociate Term from Entity | DELETE /catalog/api/glossary/terms/{termGuid}/assignedEntities | Unlinks a business term from catalog assets. |
| 44 | Get Collection Path | GET /account/api/collections/{collectionName} | Retrieves hierarchical path of a collection. |
| 45 | Create Sub-Collection | PUT /account/api/collections/{parentName}/childCollections/{childName} | Provisions a nested collection under parent. |
| 46 | Delete Collection | DELETE /account/api/collections/{collectionName} | Removes a governance collection node. |
| 47 | List Collection Role Assignments | GET /account/api/collections/{collectionName}/roleAssignments | Inspects security roles assigned to a collection. |
| 48 | Revoke Collection Role Assignment | DELETE /account/api/collections/{collectionName}/roleAssignments/{roleAssignmentId} | Revokes security access from a collection. |
| 49 | Get Key Vault Connection | GET /scan/api/keyvaults/{keyVaultName} | Inspects Azure Key Vault connector settings. |
| 50 | Register Key Vault | PUT /scan/api/keyvaults/{keyVaultName} | Registers Key Vault for scanning secret management. |
| 51 | List Scans for Data Source | GET /scan/api/datasources/{dataSourceName}/scans | Lists all scan configurations for a data source. |
| 52 | Create Scan Configuration | PUT /scan/api/datasources/{dataSourceName}/scans/{scanName} | Provisions a new scan schedule and rule set. |
| 53 | Run Immediate Scan | POST /scan/api/datasources/{dataSourceName}/scans/{scanName}/run | Triggers an on-demand scan execution. |
| 54 | Cancel Running Scan | POST /scan/api/datasources/{dataSourceName}/scans/{scanName}/runs/{runId}/cancel | Stops an active data scanning job. |
| 55 | Get Scan History | GET /scan/api/datasources/{dataSourceName}/scans/{scanName}/runs | Fetches execution log history for scans. |
| 56 | Get Scan Filter | GET /scan/api/datasources/{dataSourceName}/scans/{scanName}/filters/custom | Inspects asset inclusion/exclusion filters. |
| 57 | Update Scan Filter | PUT /scan/api/datasources/{dataSourceName}/scans/{scanName}/filters/custom | Updates file and path filters for scanning. |
| 58 | List System Classification Rules | GET /scan/api/systemClassificationRules | Lists default system-defined classifiers. |
| 59 | Create Custom Classification Rule | PUT /scan/api/classificationrules/{ruleName} | Creates custom regex or dictionary classifier. |
| 60 | Delete Classification Rule | DELETE /scan/api/classificationrules/{ruleName} | Removes a custom classification rule. |
| 61 | List Rule Sets | GET /scan/api/scanrulesets | Lists all system and custom scan rule sets. |
| 62 | Create Scan Rule Set | PUT /scan/api/scanrulesets/{setName} | Groups classifiers into a scan rule set. |
| 63 | Delete Scan Rule Set | DELETE /scan/api/scanrulesets/{setName} | Removes a custom scan rule set. |
| 64 | Get Lineage Edge | GET /catalog/api/atlas/v2/lineage/{guid}/next | Retrieves downstream data flow lineage steps. |
| 65 | Get Ancestor Lineage | GET /catalog/api/atlas/v2/lineage/{guid}/previous | Retrieves upstream data flow origin steps. |
| 66 | Create Custom Relationship | POST /catalog/api/atlas/v2/relationship | Creates custom relationship between assets. |
| 67 | Delete Relationship | DELETE /catalog/api/atlas/v2/relationship/guid/{guid} | Removes a relationship link between assets. |
| 68 | Get Type Definition | GET /catalog/api/atlas/v2/types/typedef/name/{name} | Inspects structural schema for type definition. |
| 69 | Delete Type Definition | DELETE /catalog/api/atlas/v2/types/typedefs | Deletes custom entity or attribute definitions. |
| 70 | List All Classifications | GET /catalog/api/atlas/v2/types/typedefs?type=classification | Lists all classification type definitions. |
| 71 | Create Custom Classification Type | POST /catalog/api/atlas/v2/types/typedefs | Defines new custom classification category. |
| 72 | Add Label to Entity | POST /catalog/api/atlas/v2/entity/guid/{guid}/labels | Applies tags/labels to a catalog asset. |
| 73 | Remove Label from Entity | DELETE /catalog/api/atlas/v2/entity/guid/{guid}/labels | Removes tags/labels from a catalog asset. |
| 74 | List Sensitivity Labels | GET /policy/api/sensitivitylabels | Lists Purview Microsoft Information Protection labels. |
| 75 | Set Asset Sensitivity Label | POST /catalog/api/entity/guid/{guid}/sensitivitylabel | Applies MIP sensitivity label to asset. |
| 76 | Get Data Map Metrics | GET /insights/api/datamap/summary | Retrieves data map asset counts and size metrics. |
| 77 | Get Governance Insights | GET /insights/api/governance/coverage | Evaluates stewardship coverage across data map. |
| 78 | Get Classification Insights | GET /insights/api/classifications/summary | Retrieves breakdown of applied classifications. |
| 79 | Get Sensitivity Insights | GET /insights/api/sensitivity/summary | Retrieves breakdown of MIP sensitivity labels. |
| 80 | Get Glossary Insights | GET /insights/api/glossary/summary | Evaluates glossary term adoption and mapping. |
| 81 | List Policy Store Rules | GET /policy/api/policystore/policies | Lists data governance access policies. |
| 82 | Create Data Access Policy | POST /policy/api/policystore/policies | Provisions access rule for Purview data map. |
| 83 | Delete Access Policy | DELETE /policy/api/policystore/policies/{policyId} | Removes data access policy from store. |
| 84 | Set Account Firewall | Set-AzPurviewAccount -Name 'org-purview' -PublicNetworkAccess Disabled | Enforces private network perimeter. |
| 85 | Create Private Endpoint | New-AzPurviewPrivateEndpointConnection | Provisions private endpoint connection. |
| 86 | Approve Private Endpoint | Approve-AzPurviewPrivateEndpointConnection | Approves pending private link request. |
| 87 | Reject Private Endpoint | Deny-AzPurviewPrivateEndpointConnection | Rejects private link connection request. |
| 88 | List Private Endpoints | Get-AzPurviewPrivateEndpointConnection | Lists all connected private endpoints. |
| 89 | Set Resource Tags | Update-AzPurviewAccount -Name 'org-purview' -Tag @{Env='Prod'} | Applies Azure tags to Purview resource. |
| 90 | Get Event Hub Notification Config | GET /account/api/eventhub/notification | Inspects Kafka/Event Hub streaming hooks. |
| 91 | Set Event Hub Notification Config | PUT /account/api/eventhub/notification | Configures streaming diagnostic notification hub. |
| 92 | Get Purview SKU Info | Get-AzPurviewAccountSku | Inspects throughput capacity and SKU units. |
| 93 | Update Purview SKU | Update-AzPurviewAccount -Name 'org-purview' -SkuCapacity 4 | Scales Purview Data Map capacity units. |
| 94 | List Managed Resources | Get-AzPurviewManagedResource | Lists storage accounts managed by Purview. |
| 95 | Get Scan Diagnostics | GET /scan/api/diagnostics/summary | Retrieves error logs for failed scan jobs. |
| 96 | Purge Catalog Cache | POST /catalog/api/cache/purge | Flushes temporary search and query caches. |
| 97 | Verify Metastore Sync | GET /catalog/api/metastore/sync/status | Checks metadata synchronization state. |
| 98 | List Business Metadata Types | GET /catalog/api/types/typedefs?type=business_metadata | Lists custom business metadata groups. |
| 99 | Assign Business Metadata | POST /catalog/api/atlas/v2/entity/guid/{guid}/businessmetadata | Applies business metadata attributes to asset. |
| 100 | Remove Business Metadata | DELETE /catalog/api/atlas/v2/entity/guid/{guid}/businessmetadata | Removes business metadata attributes from asset. |
| 101 | Get Private Link Resource | Get-AzPurviewPrivateLinkResource -AccountName 'org-purview' | Lists supported private link resource types. |
| 102 | New Private Link Service | New-AzPurviewPrivateEndpointConnection | Provisions a private endpoint for secure catalog traffic. |
| 103 | Get Account Key Vault Link | Get-AzPurviewKeyVault -AccountName 'org-purview' | Retrieves Key Vault integration references. |
| 104 | Add Key Vault Connection | New-AzPurviewKeyVault -AccountName 'org-purview' -KeyVaultUrl 'https://kv.vault.azure.net/' | Registers Key Vault for scanning secret management. |
| 105 | Remove Key Vault Connection | Remove-AzPurviewKeyVault -AccountName 'org-purview' -KeyVaultName 'kv' | Deletes Key Vault integration from Purview. |
| 106 | Get Data Factory Lineage Sync | GET /catalog/api/atlas/v2/lineage/datafactory/{factoryGuid} | Inspects Azure Data Factory pipeline lineage sync status. |
| 107 | Get Databricks Lineage Sync | GET /catalog/api/atlas/v2/lineage/databricks/{workspaceId} | Inspects Unity Catalog to Purview lineage connector. |
| 108 | Get Synapse Lineage Sync | GET /catalog/api/atlas/v2/lineage/synapse/{workspaceGuid} | Inspects Azure Synapse Analytics pipeline lineage sync. |
| 109 | Get Snowflake Lineage Sync | GET /catalog/api/atlas/v2/lineage/snowflake/{accountName} | Inspects Snowflake data map lineage extraction. |
| 110 | Get PowerBI Lineage Sync | GET /catalog/api/atlas/v2/lineage/powerbi/{tenantId} | Inspects PowerBI dashboard and dataset lineage flow. |
| 111 | Get SQL Server Lineage Sync | GET /catalog/api/atlas/v2/lineage/sqlserver/{serverGuid} | Inspects SQL Server stored procedure lineage sync. |
| 112 | Create Custom Atlas Type | POST /catalog/api/atlas/v2/types/typedefs | Provisions custom COM_Asset type in Atlas graph. |
| 113 | Get Entity Lineage Depth | GET /catalog/api/atlas/v2/lineage/{guid}?direction=BOTH&depth=5 | Fetches 5-level upstream and downstream lineage graph. |
| 114 | Get Lineage Impact Analysis | GET /catalog/api/atlas/v2/lineage/{guid}/impact | Evaluates downstream impact score for asset changes. |
| 115 | Set Sensitivity Label Batch | POST /catalog/api/atlas/v2/entity/bulk/classification | Applies sensitivity classification to batch of GUIDs. |
| 116 | Remove Sensitivity Label Batch | DELETE /catalog/api/atlas/v2/entity/bulk/classification | Removes sensitivity tags from batch of GUIDs. |
| 117 | Get Data Map Capacity Units | Get-AzPurviewAccount -Name 'org-purview' | Select-Object SkuCapacity | Inspects provisioned capacity units (4 CUs = 10k assets/sec). |
| 118 | Set Data Map Auto Scale | Set-AzPurviewAccount -Name 'org-purview' -SkuCapacity 16 | Scales Purview Data Map to 16 CUs for large ingestion. |
| 119 | Export Data Map Entities CSV | POST /catalog/api/atlas/v2/entity/export | Exports asset catalog to downloadable CSV archive. |
| 120 | Import Data Map Entities CSV | POST /catalog/api/atlas/v2/entity/import | Imports external metadata assets from CSV payload. |
| 121 | Get Atlas Business Metadata Groups | GET /catalog/api/atlas/v2/types/typedefs?type=business_metadata | Lists all custom business metadata groups. |
| 122 | Get Business Metadata Group Schema | GET /catalog/api/atlas/v2/types/typedef/name/{groupName} | Inspects schema of custom business metadata group. |
| 123 | Delete Business Metadata Group | DELETE /catalog/api/atlas/v2/types/typedefs | Deletes custom business metadata group definition. |
| 124 | Get Term Parent Hierarchy | GET /catalog/api/glossary/terms/{termGuid}/parents | Retrieves parent term taxonomy nodes. |
| 125 | Get Term Child Hierarchy | GET /catalog/api/glossary/terms/{termGuid}/children | Retrieves child term taxonomy nodes. |
| 126 | Link Related Terms | POST /catalog/api/glossary/terms/{termGuid}/related | Creates bidirectional relationship between business terms. |
| 127 | Unlink Related Terms | DELETE /catalog/api/glossary/terms/{termGuid}/related | Removes relationship link between business terms. |
| 128 | Get Term Synonyms | GET /catalog/api/glossary/terms/{termGuid}/synonyms | Lists alternate synonym names for business term. |
| 129 | Add Term Synonym | POST /catalog/api/glossary/terms/{termGuid}/synonyms | Adds alternate synonym to business term. |
| 130 | Get Term Acronyms | GET /catalog/api/glossary/terms/{termGuid}/acronyms | Lists business acronyms mapped to term. |
| 131 | Add Term Acronym | POST /catalog/api/glossary/terms/{termGuid}/acronyms | Adds business acronym mapping to term. |
| 132 | Get Collection Hierarchy Tree | GET /account/api/collections/tree | Fetches complete organizational collection tree. |
| 133 | Move Asset Between Collections | POST /catalog/api/atlas/v2/entity/guid/{guid}/move?targetCollection={collectionName} | Reassigns asset to new collection node. |
| 134 | Bulk Move Assets Between Collections | POST /catalog/api/atlas/v2/entity/bulk/move | Batch reassigns assets to new collection node. |
| 135 | Get Collection Stats | GET /account/api/collections/{collectionName}/stats | Calculates total sub-collections and assets in collection. |
| 136 | List Self-Hosted Integration Runtimes | GET /scan/api/integrationruntimes | Lists on-premises SHIR agents for scanning local DBs. |
| 137 | Get Self-Hosted IR Status | GET /scan/api/integrationruntimes/{irName}/status | Inspects health and CPU/RAM load of SHIR agent. |
| 138 | Get Self-Hosted IR Key | POST /scan/api/integrationruntimes/{irName}/listauthkeys | Generates registration key for local SHIR installation. |
| 139 | Regenerate Self-Hosted IR Key | POST /scan/api/integrationruntimes/{irName}/regenerateauthkey | Rotates security registration key for SHIR agent. |
| 140 | Delete Self-Hosted IR | DELETE /scan/api/integrationruntimes/{irName} | Removes on-premises SHIR connector. |
| 141 | Get Scan Schedule | GET /scan/api/datasources/{ds}/scans/{scanName}/triggers/default | Inspects recurring cron scanning schedule. |
| 142 | Set Scan Schedule Cron | PUT /scan/api/datasources/{ds}/scans/{scanName}/triggers/default | Schedules weekly/monthly automated scan cron. |
| 143 | Disable Scan Schedule | DELETE /scan/api/datasources/{ds}/scans/{scanName}/triggers/default | Deactivates automated scan schedule. |
| 144 | Get Scan Execution Diagnostics Log | GET /scan/api/datasources/{ds}/scans/{scanName}/runs/{runId}/error | Pulls error log trace for failed scan run. |
| 145 | Get Custom Classification Rule RegEx | GET /scan/api/classificationrules/{ruleName}/patterns | Inspects regular expression pattern for classifier. |
| 146 | Get Classification Rule Dictionary | GET /scan/api/classificationrules/{ruleName}/dictionary | Inspects match dictionary terms for classifier. |
| 147 | Get Sensitivity Label Policy Target | GET /policy/api/sensitivitylabels/policies | Inspects MIP sensitivity label auto-apply policies. |
| 148 | Create Sensitivity Label Rule | POST /policy/api/sensitivitylabels/rules | Provisions rule auto-labeling assets matching classifications. |
| 149 | Get Policy Enforcement Point | GET /policy/api/enforcement/status | Verifies policy enforcement state across target storage. |
| 150 | Create Data Governance Role | POST /account/api/roles | Provisions custom role in Purview access control. |
| 151 | Get User Assigned Roles | GET /account/api/users/{userId}/roles | Lists Purview roles assigned to specific Azure AD principal. |
| 152 | Grant User Collection Admin | POST /account/api/collections/{col}/roleAssignments | Grants Collection Admin role to Azure AD principal. |
| 153 | Grant User Data Curator | POST /account/api/collections/{col}/roleAssignments | Grants Data Curator role to Azure AD principal. |
| 154 | Grant User Data Reader | POST /account/api/collections/{col}/roleAssignments | Grants Data Reader role to Azure AD principal. |
| 155 | Grant User Workflow Admin | POST /account/api/collections/{col}/roleAssignments | Grants Workflow Admin role to Azure AD principal. |
| 156 | List Data Workflows | GET /workflow/api/workflows | Lists automated data governance workflows. |
| 157 | Create Data Workflow | POST /workflow/api/workflows | Provisions approval workflow for term creation/asset edits. |
| 158 | Update Data Workflow | PUT /workflow/api/workflows/{workflowId} | Modifies BPMN approval workflow steps. |
| 159 | Delete Data Workflow | DELETE /workflow/api/workflows/{workflowId} | Removes governance workflow. |
| 160 | Get Workflow Run History | GET /workflow/api/workflowruns | Inspects pending and completed workflow executions. |
| 161 | Approve Workflow Request | POST /workflow/api/userrequests/{requestId}/approve | Approves pending governance approval ticket. |
| 162 | Reject Workflow Request | POST /workflow/api/userrequests/{requestId}/reject | Rejects pending governance approval ticket. |
| 163 | Get User Inbox Tasks | GET /workflow/api/userrequests/pending | Lists active pending approval tasks assigned to current user. |
| 164 | Get Metastore Sync Logs | GET /catalog/api/metastore/sync/logs | Pulls execution logs for Hive Metastore / Unity sync. |
| 165 | Get Data Map Search Autocomplete | POST /catalog/api/search/autocomplete | Provides real-time search term completion suggestions. |
| 166 | Get Data Map Search Suggest | POST /catalog/api/search/suggest | Provides fuzzy asset search suggestions. |
| 167 | Get Asset Relationships List | GET /catalog/api/atlas/v2/entity/guid/{guid}/relationships | Lists all connected edge relationships for asset. |
| 168 | Get Asset Classification History | GET /catalog/api/atlas/v2/entity/guid/{guid}/classificationHistory | Audit trail of applied/removed classifications. |
| 169 | Get Data Map Schema Drift | GET /insights/api/schema/drift | Identifies tables where physical schema drifted from catalog. |
| 170 | Get Unclassified Assets Report | GET /insights/api/assets/unclassified | Lists assets lacking applied classifications. |
| 171 | Get Uncurated Assets Report | GET /insights/api/assets/uncurated | Lists assets lacking business term or owner assignment. |
| 172 | Get Stale Assets Report | GET /insights/api/assets/stale | Lists assets untouched by scans in > 90 days. |
| 173 | Set Account Storage Firewall | Set-AzPurviewAccount -Name 'org-purview' -PublicNetworkAccess Disabled | Blocks public internet traffic to Purview endpoint. |
| 174 | Get Account Private Endpoint Connections | Get-AzPurviewPrivateEndpointConnection -AccountName 'org-purview' | Lists active private endpoint connections. |
| 175 | Delete Private Endpoint Connection | Remove-AzPurviewPrivateEndpointConnection -AccountName 'org-purview' -Name 'pe-1' | Deletes private endpoint connection. |
| 176 | Get Account Managed Identity | Get-AzPurviewAccount -Name 'org-purview' | Select-Object Identity | Inspects System-Assigned Managed Identity Object ID. |
| 177 | Grant Managed Identity Key Vault Access | Set-AzKeyVaultAccessPolicy -VaultName 'kv' -ObjectId '{purviewMsiId}' -PermissionsToSecrets Get,List | Grants Purview MSI access to Key Vault. |
| 178 | Grant Managed Identity Storage Access | New-AzRoleAssignment -ObjectId '{purviewMsiId}' -RoleDefinitionName 'Storage Blob Data Reader' -Scope '/subscriptions/123/...' | Grants Purview MSI storage read rights. |
| 179 | Grant Managed Identity SQL Access | CREATE USER [org-purview] FROM EXTERNAL PROVIDER; ALTER ROLE db_datareader ADD MEMBER [org-purview]; | Grants Purview MSI SQL Server read rights. |
| 180 | Get Notification Event Stream Config | GET /account/api/notification/config | Inspects Kafka/Event Hub streaming hooks for data map mutations. |
| 181 | Set Notification Event Stream Config | PUT /account/api/notification/config | Configures streaming topic for Purview atlas mutation events. |
| 182 | Test Kafka Notification Producer | POST /account/api/notification/test | Sends test payload to Kafka/Event Hub topic. |
| 183 | Get Catalog Audit Trail | GET /account/api/audit/logs | Pulls administrative modification audit logs. |
| 184 | Get Metastore Entity Counts | GET /catalog/api/atlas/v2/types/typedefs/summary | Outputs entity counts categorized by type. |
| 185 | Export Catalog Lineage Graph | GET /catalog/api/atlas/v2/lineage/export | Exports lineage DAG to GraphML/JSON format. |
| 186 | Get Glossary Term Access Control | GET /catalog/api/glossary/terms/{guid}/accessControl | Inspects ABAC access policies applied to term. |
| 187 | Set Glossary Term Access Control | PUT /catalog/api/glossary/terms/{guid}/accessControl | Restricts term edit/view permissions to specific roles. |
| 188 | Get Purview API Version | GET /account/api/version | Outputs Purview REST API build version string. |
| 189 | Check Data Map Ping | GET /account/api/ping | Health check endpoint returning 200 OK. |
| 190 | Get Data Map Search Filters | POST /catalog/api/search/filters | Inspects available search facets and filters. |
| 191 | Get Data Map Asset Owners | GET /catalog/api/atlas/v2/entity/guid/{guid}/owners | Lists assigned business and technical owners. |
| 192 | Set Data Map Asset Owner | POST /catalog/api/atlas/v2/entity/guid/{guid}/owners | Assigns business or technical owner to asset. |
| 193 | Remove Data Map Asset Owner | DELETE /catalog/api/atlas/v2/entity/guid/{guid}/owners | Removes assigned owner from asset. |
| 194 | Get Data Map Asset Experts | GET /catalog/api/atlas/v2/entity/guid/{guid}/experts | Lists assigned subject matter experts. |
| 195 | Set Data Map Asset Expert | POST /catalog/api/atlas/v2/entity/guid/{guid}/experts | Assigns subject matter expert to asset. |
| 196 | Remove Data Map Asset Expert | DELETE /catalog/api/atlas/v2/entity/guid/{guid}/experts | Removes subject matter expert from asset. |
| 197 | Get Asset Schema Columns | GET /catalog/api/atlas/v2/entity/guid/{guid}/schema | Retrieves column schema definitions for table asset. |
| 198 | Get Column Classification Details | GET /catalog/api/atlas/v2/entity/guid/{guid}/classifications | Lists classifications applied to column. |
| 199 | Add Column Classification | POST /catalog/api/atlas/v2/entity/guid/{guid}/classifications | Applies classification tag to column. |
| 200 | Remove Column Classification | DELETE /catalog/api/atlas/v2/entity/guid/{guid}/classifications/{name} | Removes classification tag from column. |
Collibra Governance Gov
Technical Architecture & Overview
Collibra Governance is an enterprise Data Intelligence Cloud platform that combines data governance, data catalog, data lineage, and data quality into a unified metadata repository. It operates on an operating model composed of Communities, Domains, Asset Types, and Attributes, providing an enterprise-wide system of record for data assets, policies, and business concepts.
Primary Use Cases: Enterprise data governance stewardship, data privacy and compliance (GDPR, CCPA, BCBS 239), business glossary standardization, automated pipeline impact analysis, workflow-driven data access approvals, and data quality rule enforcement.
Core Components: Collibra DGC (Operating Model & Governance Engine), Collibra Catalog (metadata ingestion & automated classification), Collibra Lineage (automated harvest of SQL, ETL, BI scripts), Collibra Edge (on-premises secure agent), and BPMN Workflow Engine.
Exhaustive 200-command administrative, diagnostic, and operational matrix for Collibra Governance.
| # | Operation / Action | API Endpoint / Syntax | Description |
|---|---|---|---|
| 1 | Get All Assets | GET /rest/2.0/assets | Retrieves paginated catalog assets. |
| 2 | Create Asset | POST /rest/2.0/assets | Provisions a new catalog object. |
| 3 | Update Asset | PATCH /rest/2.0/assets/{id} | Modifies asset properties. |
| 4 | Delete Asset | DELETE /rest/2.0/assets/{id} | Removes an asset from the catalog. |
| 5 | Find Asset by ID | GET /rest/2.0/assets/{id} | Fetches a single asset's details. |
| 6 | List Domains | GET /rest/2.0/domains | Retrieves governance domains. |
| 7 | Create Domain | POST /rest/2.0/domains | Creates a logical asset domain. |
| 8 | List Communities | GET /rest/2.0/communities | Fetches organizational communities. |
| 9 | Create Community | POST /rest/2.0/communities | Establishes a governance community. |
| 10 | Get Asset Lineage | GET /rest/2.0/lineage/{id}/upstream | Inspects data lineage upstream. |
| 11 | Create Relation | POST /rest/2.0/relations | Links two catalog assets together. |
| 12 | List Relations | GET /rest/2.0/relations | Retrieves asset dependencies. |
| 13 | Assign Responsibility | POST /rest/2.0/responsibilities | Delegates data stewardship. |
| 14 | Get Data Quality Rules | GET /rest/2.0/dataQualityRules | Fetches DQ validation logic. |
| 15 | Create Data Quality Rule | POST /rest/2.0/dataQualityRules | Adds a metric validation rule. |
| 16 | List Users | GET /rest/2.0/users | Retrieves platform user accounts. |
| 17 | Create User | POST /rest/2.0/users | Provisions a new platform user. |
| 18 | List Groups | GET /rest/2.0/userGroups | Retrieves user permission groups. |
| 19 | Assign User to Group | POST /rest/2.0/userGroups/{id}/users | Adds user to security group. |
| 20 | Export Workflow Definition | GET /rest/2.0/workflows/processes | Fetches BPMN governance workflows. |
| 21 | Deploy Workflow | POST /rest/2.0/workflows/processes | Uploads a new approval workflow. |
| 22 | Get Workflow Tasks | GET /rest/2.0/workflowTasks | Lists pending approval tasks. |
| 23 | Complete Workflow Task | POST /rest/2.0/workflowTasks/{id}/complete | Approves/rejects a governance ticket. |
| 24 | Search Global Index | GET /rest/2.0/search | Executes enterprise catalog search. |
| 25 | Get Asset Attributes | GET /rest/2.0/attributes?assetId={id} | Retrieves metadata attributes. |
| 26 | Create Attribute | POST /rest/2.0/attributes | Adds custom metadata fields. |
| 27 | Get Asset Types | GET /rest/2.0/assetTypes | Lists available asset type schemas. |
| 28 | Create Asset Type | POST /rest/2.0/assetTypes | Provisions a custom asset type. |
| 29 | Get System Health | GET /rest/2.0/system/status | Verifies backend engine status. |
| 30 | Purge Trash | POST /rest/2.0/trash/empty | Permanently deletes archived objects. |
| 31 | Get Domain Details | GET /rest/2.0/domains/{id} | Retrieves properties of a specific domain. |
| 32 | Update Domain | PATCH /rest/2.0/domains/{id} | Modifies domain attributes or parent community. |
| 33 | Delete Domain | DELETE /rest/2.0/domains/{id} | Removes a domain and optionally contents. |
| 34 | Get Community Details | GET /rest/2.0/communities/{id} | Retrieves details of a specific community. |
| 35 | Update Community | PATCH /rest/2.0/communities/{id} | Modifies community properties. |
| 36 | Delete Community | DELETE /rest/2.0/communities/{id} | Removes a community node. |
| 37 | Get Downstream Lineage | GET /rest/2.0/lineage/{id}/downstream | Inspects downstream impact analysis. |
| 38 | Get Full Lineage Graph | GET /rest/2.0/lineage/{id}/graph | Extracts complete upstream and downstream DAG. |
| 39 | Get Relation Type | GET /rest/2.0/relationTypes/{id} | Inspects definition of a relation type. |
| 40 | Create Relation Type | POST /rest/2.0/relationTypes | Defines new relationship schema between asset types. |
| 41 | Delete Relation | DELETE /rest/2.0/relations/{id} | Removes relationship link between assets. |
| 42 | List Responsibilities | GET /rest/2.0/responsibilities | Lists data stewardship assignments. |
| 43 | Delete Responsibility | DELETE /rest/2.0/responsibilities/{id} | Revokes stewardship assignment from user. |
| 44 | Get Role | GET /rest/2.0/roles/{id} | Retrieves security role definition. |
| 45 | List Roles | GET /rest/2.0/roles | Lists all system and custom governance roles. |
| 46 | Create Role | POST /rest/2.0/roles | Provisions a new custom governance role. |
| 47 | Get Attribute Type | GET /rest/2.0/attributeTypes/{id} | Inspects schema of attribute type definition. |
| 48 | Create Attribute Type | POST /rest/2.0/attributeTypes | Provisions custom attribute definition. |
| 49 | Update Attribute | PATCH /rest/2.0/attributes/{id} | Modifies value of an existing asset attribute. |
| 50 | Delete Attribute | DELETE /rest/2.0/attributes/{id} | Removes an attribute from an asset. |
| 51 | Get Complex Relation | GET /rest/2.0/complexRelations/{id} | Retrieves multi-way relationship object. |
| 52 | Create Complex Relation | POST /rest/2.0/complexRelations | Provisions N-ary relation among multiple assets. |
| 53 | Delete Complex Relation | DELETE /rest/2.0/complexRelations/{id} | Removes multi-way relationship object. |
| 54 | Get DQ Metric Results | GET /rest/2.0/dataQualityResults | Fetches history of DQ execution metrics. |
| 55 | Add DQ Metric Result | POST /rest/2.0/dataQualityResults | Posts new DQ test execution score. |
| 56 | Get User Profile | GET /rest/2.0/users/{id} | Fetches detailed account info for a user. |
| 57 | Update User Account | PATCH /rest/2.0/users/{id} | Updates email, roles, or status of a user. |
| 58 | Disable User Account | POST /rest/2.0/users/{id}/disable | Deactivates a user login. |
| 59 | Enable User Account | POST /rest/2.0/users/{id}/enable | Reactivates a user login. |
| 60 | Get User Group | GET /rest/2.0/userGroups/{id} | Retrieves user group properties. |
| 61 | Remove User from Group | DELETE /rest/2.0/userGroups/{id}/users/{userId} | Removes a user from permission group. |
| 62 | Get Workflow Instance | GET /rest/2.0/workflows/instances/{id} | Inspects running BPMN workflow instance. |
| 63 | Start Workflow Instance | POST /rest/2.0/workflows/processes/{id}/start | Triggers execution of governance workflow. |
| 64 | Cancel Workflow Instance | POST /rest/2.0/workflows/instances/{id}/cancel | Aborts a running workflow process. |
| 65 | List Workflow Tasks for User | GET /rest/2.0/workflowTasks?userId={userId} | Lists pending inbox tasks for specific user. |
| 66 | Reassign Workflow Task | POST /rest/2.0/workflowTasks/{id}/reassign | Delegates approval task to another user. |
| 67 | Get Comment | GET /rest/2.0/comments/{id} | Retrieves specific asset discussion comment. |
| 68 | Add Comment to Asset | POST /rest/2.0/comments | Posts a collaboration note on catalog asset. |
| 69 | Delete Comment | DELETE /rest/2.0/comments/{id} | Removes discussion comment. |
| 70 | Get Attachment | GET /rest/2.0/attachments/{id} | Retrieves file attachment metadata. |
| 71 | Upload Attachment | POST /rest/2.0/attachments | Attaches document/spec file to catalog asset. |
| 72 | Delete Attachment | DELETE /rest/2.0/attachments/{id} | Removes attached file from asset. |
| 73 | Get Tag | GET /rest/2.0/tags/{id} | Retrieves specific catalog tag. |
| 74 | Add Tag to Asset | POST /rest/2.0/tags/assign | Applies descriptive tag to asset. |
| 75 | Remove Tag from Asset | POST /rest/2.0/tags/unassign | Removes descriptive tag from asset. |
| 76 | Get View Count | GET /rest/2.0/navigation/mostViewed | Retrieves popularity metrics for catalog assets. |
| 77 | Export Catalog Assets CSV | POST /rest/2.0/outputModule/export/csv | Exports search or domain assets to CSV. |
| 78 | Export Catalog Assets Excel | POST /rest/2.0/outputModule/export/excel | Exports asset catalog to Excel file. |
| 79 | Import Data via Job | POST /rest/2.0/jobs/import | Bulk imports catalog entities via JSON/CSV. |
| 80 | Get Job Status | GET /rest/2.0/jobs/{id} | Monitors background import/export batch job. |
| 81 | Cancel Job | POST /rest/2.0/jobs/{id}/cancel | Stops background processing batch job. |
| 82 | Get System Info | GET /rest/2.0/system/info | Inspects version, license, and cluster build. |
| 83 | Get License Details | GET /rest/2.0/system/license | Inspects active Collibra license tier and quotas. |
| 84 | Get Audit Logs | GET /rest/2.0/auditLogs | Fetches security and administrative audit event trail. |
| 85 | Reindex Search Index | POST /rest/2.0/search/reindex | Triggers full catalog search index rebuild. |
| 86 | Get Edge Site Status | GET /rest/2.0/edge/sites | Monitors status of Collibra Edge connectors. |
| 87 | Create Edge Integration Job | POST /rest/2.0/edge/jobs | Schedules ingestion job via Edge site. |
| 88 | Get Ingestion Capability | GET /rest/2.0/edge/capabilities | Inspects supported databases on Edge sites. |
| 89 | List Governance Rules | GET /rest/2.0/rules | Lists business policies and validation logic. |
| 90 | Create Governance Rule | POST /rest/2.0/rules | Provisions new policy validation rule. |
| 91 | Delete Governance Rule | DELETE /rest/2.0/rules/{id} | Removes governance policy rule. |
| 92 | Get Custom Icon | GET /rest/2.0/icons/{id} | Retrieves custom UI icon definition. |
| 93 | Upload Custom Icon | POST /rest/2.0/icons | Uploads custom asset icon graphics. |
| 94 | Get Mail Configuration | GET /rest/2.0/mail/status | Inspects SMTP email notification server. |
| 95 | Send Test Mail | POST /rest/2.0/mail/test | Sends test email to verify SMTP gateway. |
| 96 | Get LDAP Config | GET /rest/2.0/ldap/configuration | Inspects enterprise directory integration. |
| 97 | Sync LDAP Users | POST /rest/2.0/ldap/sync | Executes directory user synchronization. |
| 98 | Get SSO SAML Metadata | GET /rest/2.0/sso/saml/metadata | Exports SAML service provider metadata. |
| 99 | Purge Asset Permanently | DELETE /rest/2.0/assets/{id}/purge | Bypasses trash and purges asset. |
| 100 | Restore Asset from Trash | POST /rest/2.0/trash/restore | Restores archived asset from trash bin. |
| 101 | Purge Asset Permanently | DELETE /rest/2.0/assets/{id}/purge | Bypasses trash and purges asset. |
| 102 | Restore Asset from Trash | POST /rest/2.0/trash/restore | Restores archived asset from trash bin. |
| 103 | Get All Communities Paginated | GET /rest/2.0/communities?limit=100&offset=0 | Paginates through organizational communities. |
| 104 | Get Sub-Communities | GET /rest/2.0/communities?parentId={id} | Lists nested sub-communities under parent. |
| 105 | Get Community Domains | GET /rest/2.0/domains?communityId={id} | Lists governance domains within community. |
| 106 | Get Domain Assets Paginated | GET /rest/2.0/assets?domainId={id}&limit=100 | Paginates assets contained in domain. |
| 107 | Change Asset Domain | POST /rest/2.0/assets/{id}/domain/{targetDomainId} | Moves asset to different governance domain. |
| 108 | Change Asset Name | PATCH /rest/2.0/assets/{id} | Updates primary display name of asset. |
| 109 | Change Asset Type | POST /rest/2.0/assets/{id}/type/{targetTypeId} | Converts asset to different asset type. |
| 110 | Get Asset Status | GET /rest/2.0/assets/{id}/status | Inspects lifecycle status (Candidate, Approved, Obsolete). |
| 111 | Set Asset Status | POST /rest/2.0/assets/{id}/status/{statusId} | Updates lifecycle status of asset. |
| 112 | Get Asset Relations By Type | GET /rest/2.0/relations?sourceId={id}&relationTypeId={relTypeId} | Lists relations matching specific type. |
| 113 | Delete Relations Batch | DELETE /rest/2.0/relations/bulk | Batch deletes relationship links. |
| 114 | Get Complex Relation Type | GET /rest/2.0/complexRelationTypes/{id} | Inspects definition of complex relation type. |
| 115 | List Complex Relation Types | GET /rest/2.0/complexRelationTypes | Lists all complex relation schemas. |
| 116 | Create Complex Relation Type | POST /rest/2.0/complexRelationTypes | Provisions new multi-way relation schema. |
| 117 | Delete Complex Relation Type | DELETE /rest/2.0/complexRelationTypes/{id} | Deletes complex relation schema. |
| 118 | Get Attribute Types By Group | GET /rest/2.0/attributeTypes?groupId={id} | Lists attribute types belonging to group. |
| 119 | List Attribute Type Groups | GET /rest/2.0/attributeTypeGroups | Lists attribute type organization groups. |
| 120 | Create Attribute Type Group | POST /rest/2.0/attributeTypeGroups | Provisions new attribute organization group. |
| 121 | Get Asset Type Assignment | GET /rest/2.0/assignments?assetTypeId={id} | Inspects allowed attributes/relations for asset type. |
| 122 | Create Asset Type Assignment | POST /rest/2.0/assignments | Binds attribute/relation types to an asset type. |
| 123 | Update Asset Type Assignment | PATCH /rest/2.0/assignments/{id} | Modifies allowed attribute cardinality/rules. |
| 124 | Delete Asset Type Assignment | DELETE /rest/2.0/assignments/{id} | Unbinds attribute/relation types from asset type. |
| 125 | Get Scope Definition | GET /rest/2.0/scopes/{id} | Inspects scope governing assignment rules. |
| 126 | List Scopes | GET /rest/2.0/scopes | Lists global and domain scopes. |
| 127 | Create Scope | POST /rest/2.0/scopes | Provisions governance assignment scope. |
| 128 | Get Stewardship Role Assignments | GET /rest/2.0/responsibilities?roleId={roleId} | Lists all stewards assigned to specific role. |
| 129 | Add Responsibility Batch | POST /rest/2.0/responsibilities/bulk | Batch assigns stewardship roles across assets. |
| 130 | Remove Responsibility Batch | DELETE /rest/2.0/responsibilities/bulk | Batch revokes stewardship assignments. |
| 131 | Get User Permissions Summary | GET /rest/2.0/users/{id}/permissions | Calculates global and domain permissions for user. |
| 132 | Get Group Permissions Summary | GET /rest/2.0/userGroups/{id}/permissions | Calculates permissions for security group. |
| 133 | Grant Global Permission | POST /rest/2.0/permissions | Grants global administrative permission to group/role. |
| 134 | Revoke Global Permission | DELETE /rest/2.0/permissions/{id} | Revokes global administrative permission. |
| 135 | Get Workflow Process Definition | GET /rest/2.0/workflows/processes/{id} | Retrieves BPMN XML definition of workflow. |
| 136 | Update Workflow Process Definition | PUT /rest/2.0/workflows/processes/{id} | Updates BPMN XML code of workflow. |
| 137 | Delete Workflow Process Definition | DELETE /rest/2.0/workflows/processes/{id} | Deletes governance workflow definition. |
| 138 | Get Workflow Task Form Data | GET /rest/2.0/workflowTasks/{id}/formProperties | Fetches required user input fields for task. |
| 139 | Submit Task Form Data | POST /rest/2.0/workflowTasks/{id}/completed | Submits completed form data to advance workflow. |
| 140 | Get Workflow Variable | GET /rest/2.0/workflows/instances/{id}/variables/{name} | Inspects process variable in workflow instance. |
| 141 | Set Workflow Variable | PUT /rest/2.0/workflows/instances/{id}/variables/{name} | Modifies process variable in workflow instance. |
| 142 | Get Data Quality Rule Definition | GET /rest/2.0/dataQualityRules/{id} | Inspects pass/fail logic of DQ rule. |
| 143 | Update Data Quality Rule | PATCH /rest/2.0/dataQualityRules/{id} | Modifies threshold or metric logic of DQ rule. |
| 144 | Delete Data Quality Rule | DELETE /rest/2.0/dataQualityRules/{id} | Deletes DQ rule definition. |
| 145 | Get DQ Metric Aggregations | GET /rest/2.0/dataQualityResults/aggregation | Calculates average DQ pass rates by domain. |
| 146 | Get Lineage Harvesting Execution Logs | GET /rest/2.0/lineage/harvests/{id}/logs | Pulls execution log for lineage extraction job. |
| 147 | Trigger Lineage Harvesting Job | POST /rest/2.0/lineage/harvests | Triggers automated lineage harvesting execution. |
| 148 | Cancel Lineage Harvesting Job | POST /rest/2.0/lineage/harvests/{id}/cancel | Aborts running lineage harvesting job. |
| 149 | Get Edge Connector Site Detail | GET /rest/2.0/edge/sites/{id} | Inspects health, host, and version of Edge site. |
| 150 | Upgrade Edge Connector Site | POST /rest/2.0/edge/sites/{id}/upgrade | Triggers remote software upgrade of Edge agent. |
| 151 | Get Edge Connection Details | GET /rest/2.0/edge/connections/{id} | Inspects JDBC connection parameters on Edge site. |
| 152 | Create Edge Connection | POST /rest/2.0/edge/connections | Registers new JDBC data source on Edge site. |
| 153 | Test Edge Connection | POST /rest/2.0/edge/connections/{id}/test | Tests JDBC connectivity from Edge site to database. |
| 154 | Delete Edge Connection | DELETE /rest/2.0/edge/connections/{id} | Removes JDBC data source from Edge site. |
| 155 | Get Navigation Taxonomy Tree | GET /rest/2.0/navigation/tree | Fetches hierarchical navigation tree. |
| 156 | Get Most Frequent Search Queries | GET /rest/2.0/search/topQueries | Pulls top search keywords typed by users. |
| 157 | Get Asset View Statistics | GET /rest/2.0/assets/{id}/statistics | Inspects page views and unique visitors for asset. |
| 158 | Get Comment Thread | GET /rest/2.0/comments?assetId={id} | Retrieves threaded comments on catalog asset. |
| 159 | Update Comment | PATCH /rest/2.0/comments/{id} | Modifies text of posted comment. |
| 160 | Get Asset Ratings | GET /rest/2.0/ratings?assetId={id} | Calculates average star rating for asset. |
| 161 | Add Asset Rating | POST /rest/2.0/ratings | Submits 1-5 star rating and review for asset. |
| 162 | Delete Asset Rating | DELETE /rest/2.0/ratings/{id} | Removes star rating from asset. |
| 163 | Get Asset Favorites | GET /rest/2.0/favorites?userId={id} | Lists assets bookmarked by user. |
| 164 | Add Asset to Favorites | POST /rest/2.0/favorites | Bookmarks asset for current user. |
| 165 | Remove Asset from Favorites | DELETE /rest/2.0/favorites/{id} | Removes bookmarked asset for current user. |
| 166 | Get Asset Subscription | GET /rest/2.0/subscriptions?assetId={id} | Lists users subscribed to notification updates on asset. |
| 167 | Subscribe to Asset | POST /rest/2.0/subscriptions | Subscribes user to email notifications for asset modifications. |
| 168 | Unsubscribe from Asset | DELETE /rest/2.0/subscriptions/{id} | Unsubscribes user from asset notifications. |
| 169 | Get Active Session Count | GET /rest/2.0/system/sessions | Lists active HTTP user sessions. |
| 170 | Terminate User Session | DELETE /rest/2.0/system/sessions/{sessionId} | Force-logs out active user session. |
| 171 | Get Cache Configuration | GET /rest/2.0/system/cache | Inspects status of in-memory application caches. |
| 172 | Flush Specific Cache | POST /rest/2.0/system/cache/{cacheName}/flush | Purges specific application cache. |
| 173 | Flush All System Caches | POST /rest/2.0/system/cache/flushAll | Purges all in-memory application caches. |
| 174 | Get Backup Export File | GET /rest/2.0/system/backup | Downloads platform configuration backup ZIP archive. |
| 175 | Restore Platform Backup | POST /rest/2.0/system/restore | Restores platform configuration from ZIP archive. |
| 176 | Get Maintenance Mode Status | GET /rest/2.0/system/maintenance | Inspects whether maintenance mode is active. |
| 177 | Enable Maintenance Mode | POST /rest/2.0/system/maintenance/enable | Puts Collibra in read-only maintenance mode. |
| 178 | Disable Maintenance Mode | POST /rest/2.0/system/maintenance/disable | Restores normal read-write operation. |
| 179 | Get SAML Identity Provider Config | GET /rest/2.0/sso/saml/config | Inspects SAML IdP configuration settings. |
| 180 | Update SAML Identity Provider Config | PUT /rest/2.0/sso/saml/config | Updates SAML IdP certificate or SSO URL. |
| 181 | Get LDAP Synchronization Status | GET /rest/2.0/ldap/status | Inspects background LDAP user directory sync. |
| 182 | Cancel LDAP Synchronization | POST /rest/2.0/ldap/cancel | Aborts running LDAP user directory sync. |
| 183 | Get Mail Queue Status | GET /rest/2.0/mail/queue | Inspects pending email notification queue. |
| 184 | Purge Mail Queue | DELETE /rest/2.0/mail/queue | Clears pending email notification queue. |
| 185 | Get API Rate Limit Quotas | GET /rest/2.0/system/ratelimits | Inspects REST API rate limit counters per IP/user. |
| 186 | Get System Thread Dump | GET /rest/2.0/system/threaddump | Downloads JVM thread stack trace dump for diagnostics. |
| 187 | Get System Memory Metrics | GET /rest/2.0/system/memory | Inspects JVM heap, non-heap, and GC stats. |
| 188 | Get Database Migration Status | GET /rest/2.0/system/db/migration | Inspects database Liquibase schema migration status. |
| 189 | Check Collibra API Ping | GET /rest/2.0/system/ping | Health check endpoint returning 200 OK. |
| 190 | Get Asset Attribute History | GET /rest/2.0/attributes/{id}/history | Audit log of attribute value modifications. |
| 191 | Get Asset Relation History | GET /rest/2.0/relations/{id}/history | Audit log of relation link modifications. |
| 192 | Get Asset Type Details | GET /rest/2.0/assetTypes/{id} | Inspects structural schema for asset type. |
| 193 | Update Asset Type | PATCH /rest/2.0/assetTypes/{id} | Modifies asset type name, icon, or description. |
| 194 | Delete Asset Type | DELETE /rest/2.0/assetTypes/{id} | Removes asset type schema definition. |
| 195 | Get Community Hierarchy | GET /rest/2.0/communities/hierarchy | Fetches full community hierarchy tree. |
| 196 | Get Domain Types | GET /rest/2.0/domainTypes | Lists all domain type schemas. |
| 197 | Get Domain Type Details | GET /rest/2.0/domainTypes/{id} | Inspects structural schema for domain type. |
| 198 | Create Domain Type | POST /rest/2.0/domainTypes | Provisions custom domain type schema. |
| 199 | Delete Domain Type | DELETE /rest/2.0/domainTypes/{id} | Deletes custom domain type schema. |
| 200 | Get Role Details | GET /rest/2.0/roles/{id} | Inspects permissions assigned to role. |
Alation Catalog Sync Gov
Technical Architecture & Overview
Alation Catalog Sync provides automated metadata extraction, data search and discovery, business glossaries, and behavioral analytics. It interfaces with relational databases, cloud warehouses, BI tools, and data lakehouses using the Open Connector Framework (OCF) and native REST APIs.
Primary Use Cases: Self-service data discovery, SQL query endorsement and sharing via Alation Compose, data stewardship scoring, automated data dictionary curation, and BI dashboard lineage tracking.
Core Components: Alation Server (Django/Postgres metadata store), Open Connector Framework (OCF execution engine), Compose (collaborative SQL editor), and Lexicon (automated term extraction).
Exhaustive 200-command administrative, diagnostic, and operational matrix for Alation Catalog Sync.
| # | Operation / Action | API Endpoint / Command | Description |
|---|---|---|---|
| 1 | Get Catalog Sources | GET /integration/v1/sources/ | Lists registered database sources. |
| 2 | Trigger Metadata Extraction | POST /integration/v1/source/{id}/extract/ | Pulls schema schemas from source. |
| 3 | Get Custom Fields | GET /integration/v1/fields/ | Retrieves custom metadata attributes. |
| 4 | Set Field Value | POST /integration/v1/field_value/ | Updates custom asset property. |
| 5 | Get Table Metadata | GET /integration/v1/table/{table_id}/ | Retrieves table-level properties. |
| 6 | Get Column Metadata | GET /integration/v1/column/{column_id}/ | Fetches column-level descriptions. |
| 7 | Create Article | POST /integration/v1/article/ | Publishes a documentation wiki page. |
| 8 | List Articles | GET /integration/v1/article/ | Retrieves all documentation pages. |
| 9 | Upload Lineage Graph | POST /integration/v1/lineage/ | Inbound upstream/downstream flow. |
| 10 | Get Lineage Graph | GET /integration/v1/lineage/table/{id}/ | Retrieves table data provenance. |
| 11 | List Users | GET /integration/v1/user/ | Fetches registered catalog users. |
| 12 | Add Endorsed Query | POST /integration/v1/query/ | Publishes a certified SQL query. |
| 13 | Search Catalog | GET /api/v1/search/?q={query} | Executes metadata search query. |
| 14 | Get BI Reports | GET /integration/v1/bi_reports/ | Retrieves connected Tableau/PowerBI items. |
| 15 | Push BI Lineage | POST /integration/v1/bi_lineage/ | Syncs dashboard data dependencies. |
| 16 | Get Glossary Terms | GET /integration/v1/glossary/terms/ | Fetches enterprise dictionary. |
| 17 | Create Glossary Term | POST /integration/v1/glossary/terms/ | Adds a business data term. |
| 18 | Link Term to Column | POST /integration/v1/glossary/mapping/ | Associates term with physical column. |
| 19 | Get Stewardship Metrics | GET /integration/v1/stewardship/ | Evaluates catalog completeness score. |
| 20 | Trigger OCF Connector Sync | POST /api/v1/datasource/{id}/run_job/ | Executes Open Connector Framework job. |
| 21 | Get Job Status | GET /api/v1/job/{job_id}/ | Checks background sync task status. |
| 22 | Export Schema Dump | GET /integration/v1/export/schema/ | Downloads metadata backup payload. |
| 23 | Import Schema Metadata | POST /integration/v1/import/schema/ | Bulk ingests metadata structures. |
| 24 | Get User Groups | GET /integration/v1/group/ | Lists permission roles and groups. |
| 25 | Assign Group Permissions | POST /integration/v1/group_permissions/ | Grants dataset access rights. |
| 26 | Get Deleted Assets | GET /integration/v1/trash/ | Inspects catalog recycle bin. |
| 27 | Restore Deleted Asset | POST /integration/v1/trash/{id}/restore/ | Recovers archived catalog objects. |
| 28 | Get System Logs | GET /api/v1/admin/logs/ | Pulls container and daemon logs. |
| 29 | Test API Token | GET /integration/v1/auth/test/ | Validates authentication credentials. |
| 30 | Restart Alation Worker | sudo systemctl restart alation-worker | Restarts background processing worker. |
| 31 | Get Data Source Details | GET /integration/v1/datasource/{id}/ | Fetches configuration of specific data source. |
| 32 | Create Data Source | POST /integration/v1/datasource/ | Registers a new relational or cloud database. |
| 33 | Update Data Source | PUT /integration/v1/datasource/{id}/ | Modifies connection credentials or host parameters. |
| 34 | Delete Data Source | DELETE /integration/v1/datasource/{id}/ | Removes data source registration from catalog. |
| 35 | Get Schema List | GET /integration/v1/schema/?ds_id={id} | Lists all database schemas within a data source. |
| 36 | Get Schema Details | GET /integration/v1/schema/{id}/ | Retrieves metadata properties of a schema. |
| 37 | Update Schema Metadata | POST /integration/v1/schema/{id}/ | Updates schema description or stewardship tags. |
| 38 | Update Table Metadata | POST /integration/v1/table/{id}/ | Updates table title, description, or custom fields. |
| 39 | Delete Table Metadata | DELETE /integration/v1/table/{id}/ | Removes table entity from Alation catalog. |
| 40 | Update Column Metadata | POST /integration/v1/column/{id}/ | Modifies column description or security tags. |
| 41 | Bulk Update Columns | POST /integration/v1/column/bulk_update/ | Batch updates descriptions for multiple columns. |
| 42 | Get Query Details | GET /integration/v1/query/{id}/ | Fetches SQL text and metadata of saved query. |
| 43 | Update Query | PUT /integration/v1/query/{id}/ | Modifies SQL code or endorsement status. |
| 44 | Delete Query | DELETE /integration/v1/query/{id}/ | Removes saved query from Compose catalog. |
| 45 | Run Query in Compose | POST /api/v1/compose/execute/ | Executes query against target database engine. |
| 46 | Get Query Execution Result | GET /api/v1/compose/result/{id}/ | Fetches output dataset of executed query. |
| 47 | Get Article Details | GET /integration/v1/article/{id}/ | Fetches title and content of wiki article. |
| 48 | Update Article | PUT /integration/v1/article/{id}/ | Modifies documentation article content. |
| 49 | Delete Article | DELETE /integration/v1/article/{id}/ | Removes wiki documentation page. |
| 50 | Get Custom Field Definition | GET /integration/v1/fields/{id}/ | Inspects schema of custom field attribute. |
| 51 | Create Custom Field | POST /integration/v1/fields/ | Provisions custom metadata field for catalog objects. |
| 52 | Delete Custom Field | DELETE /integration/v1/fields/{id}/ | Removes custom metadata field definition. |
| 53 | Get User Details | GET /integration/v1/user/{id}/ | Fetches user profile, email, and group membership. |
| 54 | Create User Account | POST /integration/v1/user/ | Provisions user account in Alation. |
| 55 | Update User Account | PUT /integration/v1/user/{id}/ | Modifies user role, name, or active status. |
| 56 | Deactivate User Account | DELETE /integration/v1/user/{id}/ | Deactivates user login in Alation. |
| 57 | Get User Group Details | GET /integration/v1/group/{id}/ | Retrieves group membership and assigned roles. |
| 58 | Create User Group | POST /integration/v1/group/ | Provisions security group in Alation. |
| 59 | Add User to Group | POST /integration/v1/group/{id}/add_user/ | Adds user account to security group. |
| 60 | Remove User from Group | POST /integration/v1/group/{id}/remove_user/ | Removes user account from security group. |
| 61 | Get Trust Flag | GET /integration/v1/trust_flag/ | Lists endorsement and deprecation flags. |
| 62 | Create Trust Flag | POST /integration/v1/trust_flag/ | Applies Warning or Endorsement tag on asset. |
| 63 | Delete Trust Flag | DELETE /integration/v1/trust_flag/{id}/ | Removes Warning or Endorsement tag from asset. |
| 64 | Get Glossary Term Details | GET /integration/v1/glossary/terms/{id}/ | Retrieves definition and relationships of term. |
| 65 | Update Glossary Term | PUT /integration/v1/glossary/terms/{id}/ | Modifies business term definition or acronym. |
| 66 | Delete Glossary Term | DELETE /integration/v1/glossary/terms/{id}/ | Removes term from business glossary. |
| 67 | Get Data Dict Export | GET /integration/v1/data_dictionary/export/ | Exports data dictionary to CSV/Excel format. |
| 68 | Import Data Dict CSV | POST /integration/v1/data_dictionary/import/ | Bulk imports column descriptions from CSV. |
| 69 | Get Profiling Results | GET /integration/v1/profiling/table/{id}/ | Fetches row counts, null % and distinct counts. |
| 70 | Trigger Data Profiling | POST /integration/v1/source/{id}/profile/ | Runs automated data profiling job. |
| 71 | Get Sampling Config | GET /integration/v1/source/{id}/sample_config/ | Inspects sample query limits for profiling. |
| 72 | Set Sampling Config | PUT /integration/v1/source/{id}/sample_config/ | Modifies sample size limits for profiling. |
| 73 | Get Lineage Node | GET /integration/v1/lineage/node/{id}/ | Retrieves specific node details in lineage graph. |
| 74 | Delete Lineage Link | DELETE /integration/v1/lineage/link/{id}/ | Removes automated or manual lineage connection. |
| 75 | Get BI Server Details | GET /integration/v1/bi_server/{id}/ | Inspects connected Tableau/PowerBI server. |
| 76 | Register BI Server | POST /integration/v1/bi_server/ | Registers BI server for dashboard cataloging. |
| 77 | Trigger BI Server Sync | POST /integration/v1/bi_server/{id}/sync/ | Initiates metadata extraction from BI server. |
| 78 | Get Policy List | GET /integration/v1/policy/ | Lists access policies and data privacy rules. |
| 79 | Create Data Privacy Policy | POST /integration/v1/policy/ | Provisions data masking or restricted access rule. |
| 80 | Delete Data Policy | DELETE /integration/v1/policy/{id}/ | Removes data governance policy. |
| 81 | Get API Token List | GET /integration/v1/auth/tokens/ | Lists active API refresh tokens. |
| 82 | Create API Token | POST /integration/v1/auth/create_token/ | Generates new API authorization token. |
| 83 | Revoke API Token | POST /integration/v1/auth/revoke_token/ | Revokes API token credentials. |
| 84 | Get Catalog Usage Metrics | GET /api/v1/analytics/usage/ | Pulls active user counts and top viewed tables. |
| 85 | Get Search Popularity | GET /api/v1/analytics/search_top/ | Inspects most frequent user search terms. |
| 86 | Reindex Search Index | POST /api/v1/admin/reindex/ | Triggers search engine reindexing task. |
| 87 | Get Backup Schedule | GET /api/v1/admin/backup/config/ | Inspects automated database backup schedule. |
| 88 | Trigger Manual Backup | POST /api/v1/admin/backup/run/ | Executes immediate Alation database backup. |
| 89 | Restore Database Backup | POST /api/v1/admin/restore/ | Restores Alation metadata store from backup file. |
| 90 | Get License Quotas | GET /api/v1/admin/license/ | Inspects licensed user seats and connector quotas. |
| 91 | Update License Key | POST /api/v1/admin/license/update/ | Applies new enterprise license key file. |
| 92 | Get Network Settings | GET /api/v1/admin/network/ | Inspects proxy and SSL certificate settings. |
| 93 | Update SSL Certificate | POST /api/v1/admin/ssl/update/ | Uploads custom TLS/SSL certificate. |
| 94 | Get SMTP Settings | GET /api/v1/admin/email/config/ | Inspects outbound email notification server. |
| 95 | Update SMTP Settings | PUT /api/v1/admin/email/config/ | Modifies SMTP host, port, and credentials. |
| 96 | Send Test Email | POST /api/v1/admin/email/test/ | Sends test email to verify SMTP gateway. |
| 97 | Get SSO Configuration | GET /api/v1/admin/sso/config/ | Inspects SAML 2.0 / OIDC identity settings. |
| 98 | Update SSO Configuration | PUT /api/v1/admin/sso/config/ | Updates IdP metadata URL or SSO entity ID. |
| 99 | Flush Query Cache | POST /api/v1/admin/cache/flush/ | Clears internal query and metadata cache. |
| 100 | Get Container Health | GET /api/v1/admin/health/ | Verifies Docker/k8s container service health. |
| 101 | Purge Catalog Asset | DELETE /integration/v1/trash/{id}/purge/ | Permanently purges archived catalog object. |
| 102 | Get Data Source Connection Status | GET /integration/v1/datasource/{id}/status/ | Checks live connection status to database host. |
| 103 | Get Data Source Extraction Schedule | GET /integration/v1/datasource/{id}/schedule/ | Inspects automated metadata extraction schedule. |
| 104 | Set Data Source Extraction Schedule | PUT /integration/v1/datasource/{id}/schedule/ | Configures cron schedule for metadata extraction. |
| 105 | Get OCF Connector Version | GET /integration/v1/ocf/connector/{id}/ | Inspects installed Open Connector Framework driver version. |
| 106 | Upgrade OCF Connector | POST /integration/v1/ocf/connector/{id}/upgrade/ | Upgrades OCF connector plugin to latest version. |
| 107 | Get Table Row Count | GET /integration/v1/table/{id}/row_count/ | Fetches cached or live table row count. |
| 108 | Get Table Popularity Score | GET /integration/v1/table/{id}/popularity/ | Inspects usage popularity score based on query logs. |
| 109 | Get Column Top Values | GET /integration/v1/column/{id}/top_values/ | Fetches top frequent distinct values for column. |
| 110 | Get Column Value Distribution | GET /integration/v1/column/{id}/histogram/ | Fetches value distribution histogram for numeric column. |
| 111 | Get Article Revisions | GET /integration/v1/article/{id}/revisions/ | Lists historical revision edits for wiki page. |
| 112 | Revert Article Revision | POST /integration/v1/article/{id}/revert/{rev_id}/ | Rolls back article content to previous revision. |
| 113 | Get Article Children | GET /integration/v1/article/{id}/children/ | Lists child articles nested under parent article. |
| 114 | Get Query Execution History | GET /integration/v1/query/{id}/history/ | Inspects past execution runs of saved query. |
| 115 | Get Query Endorsements | GET /integration/v1/query/{id}/endorsements/ | Lists stewards who endorsed or deprecated query. |
| 116 | Get BI Folder List | GET /integration/v1/bi_folders/ | Lists folders in connected Tableau/PowerBI catalog. |
| 117 | Get BI Workbooks List | GET /integration/v1/bi_workbooks/ | Lists workbooks in connected BI server. |
| 118 | Get BI Datasources List | GET /integration/v1/bi_datasources/ | Lists datasources used by BI dashboards. |
| 119 | Get BI Fields List | GET /integration/v1/bi_fields/ | Lists calculated fields used in BI reports. |
| 120 | Get Glossary Hierarchy | GET /integration/v1/glossary/tree/ | Fetches full business term dictionary tree. |
| 121 | Get Term Related Terms | GET /integration/v1/glossary/terms/{id}/related/ | Lists terms linked as related concepts. |
| 122 | Link Related Terms | POST /integration/v1/glossary/terms/{id}/link_related/ | Links two business glossary terms together. |
| 123 | Get Term Synonyms | GET /integration/v1/glossary/terms/{id}/synonyms/ | Lists alternate acronyms and synonyms for term. |
| 124 | Add Term Synonym | POST /integration/v1/glossary/terms/{id}/add_synonym/ | Adds synonym to business glossary term. |
| 125 | Get Stewardship Scores by Schema | GET /integration/v1/stewardship/schema/{id}/ | Evaluates documentation completeness for schema. |
| 126 | Get Stewardship Top Contributors | GET /integration/v1/stewardship/leaderboard/ | Lists top active data stewards by edits. |
| 127 | Get Job Log Trace | GET /api/v1/job/{job_id}/log/ | Downloads execution log trace for background task. |
| 128 | Get Export Task Status | GET /integration/v1/export/task/{id}/ | Inspects status of background CSV export task. |
| 129 | Get Import Task Status | GET /integration/v1/import/task/{id}/ | Inspects status of background CSV import task. |
| 130 | Get Group Members | GET /integration/v1/group/{id}/members/ | Lists all user accounts in group. |
| 131 | Get Group Roles | GET /integration/v1/group/{id}/roles/ | Lists administrative roles assigned to group. |
| 132 | Assign Role to Group | POST /integration/v1/group/{id}/assign_role/ | Grants administrative role to group. |
| 133 | Revoke Role from Group | POST /integration/v1/group/{id}/revoke_role/ | Revokes administrative role from group. |
| 134 | Get Access Request List | GET /integration/v1/access_request/ | Lists pending data access requests submitted by users. |
| 135 | Approve Access Request | POST /integration/v1/access_request/{id}/approve/ | Approves data access request ticket. |
| 136 | Deny Access Request | POST /integration/v1/access_request/{id}/deny/ | Rejects data access request ticket. |
| 137 | Get Access Request Details | GET /integration/v1/access_request/{id}/ | Fetches justification and details for access request. |
| 138 | Get Policy Rule List | GET /integration/v1/policy_rule/ | Lists active data governance rules. |
| 139 | Create Policy Rule | POST /integration/v1/policy_rule/ | Provisions data masking or restricted access policy rule. |
| 140 | Delete Policy Rule | DELETE /integration/v1/policy_rule/{id}/ | Removes data governance policy rule. |
| 141 | Get User Bookmark List | GET /integration/v1/user/{id}/bookmarks/ | Lists catalog assets bookmarked by user. |
| 142 | Add Bookmark | POST /integration/v1/user/bookmark/ | Bookmarks catalog asset for user. |
| 143 | Remove Bookmark | DELETE /integration/v1/user/bookmark/{id}/ | Removes bookmarked catalog asset. |
| 144 | Get User Search History | GET /integration/v1/user/{id}/search_history/ | Inspects recent search queries typed by user. |
| 145 | Clear User Search History | DELETE /integration/v1/user/{id}/search_history/ | Purges search query history for user. |
| 146 | Get Compose Execution Settings | GET /api/v1/compose/settings/ | Inspects row limits and timeouts for SQL execution. |
| 147 | Set Compose Execution Settings | PUT /api/v1/compose/settings/ | Updates row limits and timeouts for SQL execution. |
| 148 | Get Compose Connection List | GET /api/v1/compose/connections/ | Lists database connections available in Compose. |
| 149 | Get Lexicon Extracted Terms | GET /integration/v1/lexicon/terms/ | Lists terms automatically mined from query logs. |
| 150 | Approve Lexicon Term | POST /integration/v1/lexicon/terms/{id}/approve/ | Promotes auto-mined term to official glossary. |
| 151 | Reject Lexicon Term | POST /integration/v1/lexicon/terms/{id}/reject/ | Discards auto-mined term. |
| 152 | Get System Config Parameter | GET /api/v1/admin/config/{key}/ | Inspects Alation system configuration parameter. |
| 153 | Set System Config Parameter | PUT /api/v1/admin/config/{key}/ | Updates Alation system configuration parameter. |
| 154 | Get Database Migration Status | GET /api/v1/admin/db_migration/status/ | Inspects Django database migration state. |
| 155 | Run Database Migration | POST /api/v1/admin/db_migration/run/ | Executes pending database migrations. |
| 156 | Get Celery Worker Status | GET /api/v1/admin/celery/status/ | Inspects active Celery background task workers. |
| 157 | Restart Celery Worker | POST /api/v1/admin/celery/restart/ | Restarts Celery background task worker process. |
| 158 | Get Redis Cache Status | GET /api/v1/admin/redis/status/ | Inspects internal Redis cache utilization. |
| 159 | Flush Redis Cache | POST /api/v1/admin/redis/flush/ | Flushes internal Redis cache memory. |
| 160 | Get Search Index Status | GET /api/v1/admin/search/status/ | Inspects status of internal search index. |
| 161 | Optimize Search Index | POST /api/v1/admin/search/optimize/ | Compacts internal search index storage. |
| 162 | Get Memory Usage Metrics | GET /api/v1/admin/metrics/memory/ | Pulls RAM usage breakdown across containers. |
| 163 | Get CPU Usage Metrics | GET /api/v1/admin/metrics/cpu/ | Pulls CPU utilization metrics. |
| 164 | Get Disk Storage Metrics | GET /api/v1/admin/metrics/disk/ | Pulls disk space usage per partition. |
| 165 | Get Audit Trail Log | GET /api/v1/admin/audit_log/ | Exports administrative event audit log. |
| 166 | Get LDAP Config Status | GET /api/v1/admin/ldap/status/ | Inspects LDAP directory integration status. |
| 167 | Test LDAP Connection | POST /api/v1/admin/ldap/test/ | Tests LDAP server connection and authentication. |
| 168 | Get SAML Config Status | GET /api/v1/admin/saml/status/ | Inspects SAML 2.0 SSO integration status. |
| 169 | Test SAML Configuration | POST /api/v1/admin/saml/test/ | Tests SAML IdP metadata and assertion parsing. |
| 170 | Get Mail Server Config | GET /api/v1/admin/email/status/ | Inspects outbound SMTP server health. |
| 171 | Get SSL Certificate Details | GET /api/v1/admin/ssl/info/ | Inspects TLS/SSL certificate expiration date. |
| 172 | Get License Seat Usage | GET /api/v1/admin/license/usage/ | Inspects assigned active user seats vs quota. |
| 173 | Check Alation System Version | GET /api/v1/admin/version/ | Outputs Alation release version and build hash. |
| 174 | Check Alation API Ping | GET /api/v1/ping/ | Health check endpoint returning 200 OK. |
| 175 | Get Column Data Types | GET /integration/v1/column/{id}/data_type/ | Inspects column native and logical data types. |
| 176 | Get Table Foreign Keys | GET /integration/v1/table/{id}/foreign_keys/ | Lists foreign key relationships for table. |
| 177 | Get Table Primary Key | GET /integration/v1/table/{id}/primary_key/ | Identifies primary key columns for table. |
| 178 | Get Table Indexes | GET /integration/v1/table/{id}/indexes/ | Lists secondary indexes on table. |
| 179 | Get Schema Table Count | GET /integration/v1/schema/{id}/table_count/ | Counts total tables in schema. |
| 180 | Get Schema View Count | GET /integration/v1/schema/{id}/view_count/ | Counts total views in schema. |
| 181 | Get Data Source Table Count | GET /integration/v1/datasource/{id}/table_count/ | Counts total tables across data source. |
| 182 | Get Data Source Query Count | GET /integration/v1/datasource/{id}/query_count/ | Counts total saved queries for data source. |
| 183 | Get Data Source User Count | GET /integration/v1/datasource/{id}/user_count/ | Counts distinct users querying data source. |
| 184 | Get User Recent Queries | GET /integration/v1/user/{id}/recent_queries/ | Lists recent queries executed by user. |
| 185 | Get User Favorite Queries | GET /integration/v1/user/{id}/favorite_queries/ | Lists favorite queries bookmarked by user. |
| 186 | Get User Published Articles | GET /integration/v1/user/{id}/articles/ | Lists wiki documentation pages published by user. |
| 187 | Get User Stewardship Assets | GET /integration/v1/user/{id}/stewardship_assets/ | Lists catalog assets mentored by user. |
| 188 | Get Article Attachments | GET /integration/v1/article/{id}/attachments/ | Lists files attached to wiki page. |
| 189 | Upload Article Attachment | POST /integration/v1/article/{id}/upload_attachment/ | Attaches file payload to wiki page. |
| 190 | Delete Article Attachment | DELETE /integration/v1/article/{id}/attachment/{att_id}/ | Removes attached file from wiki page. |
| 191 | Get Glossary Term Children | GET /integration/v1/glossary/terms/{id}/children/ | Lists child terms nested under business term. |
| 192 | Get Glossary Term Parents | GET /integration/v1/glossary/terms/{id}/parents/ | Lists parent terms governing business term. |
| 193 | Get Glossary Term Assets | GET /integration/v1/glossary/terms/{id}/assets/ | Lists physical columns and tables mapped to term. |
| 194 | Link Term to Table | POST /integration/v1/glossary/mapping/table/ | Associates business term with physical table. |
| 195 | Unlink Term from Table | DELETE /integration/v1/glossary/mapping/table/{id}/ | Removes association between term and table. |
| 196 | Unlink Term from Column | DELETE /integration/v1/glossary/mapping/column/{id}/ | Removes association between term and column. |
| 197 | Get Group User Count | GET /integration/v1/group/{id}/user_count/ | Counts total user accounts in group. |
| 198 | Check API Authentication Status | GET /integration/v1/auth/status/ | Verifies API session token validity. |
| 199 | Check API Version String | GET /integration/v1/version/ | Outputs Alation API specification version string. |
| 200 | Check System Health REST API | GET /api/v1/health/ | Queries HTTP REST endpoint for server health. |
PostgreSQL OLTP
Technical Architecture & Overview
PostgreSQL is an advanced, enterprise-grade open-source object-relational database management system (ORDBMS). It features full ACID compliance, multi-version concurrency control (MVCC), extensible data types (JSONB, PostGIS spatial, Vector, HSTORE), and sophisticated indexing mechanisms (B-Tree, GIN, GiST, BRIN, SP-GiST).
Primary Use Cases: Mission-critical OLTP applications, geo-spatial systems (PostGIS), AI vector search (pgvector), complex transactional financial platforms, and hybrid relational-document stores.
Core Components: Postmaster process, Shared Buffers, Write-Ahead Log (WAL), Background Writer, Auto-vacuum daemon, and Replication Slots (Streaming & Logical CDC).
Exhaustive 200-command administrative, diagnostic, and operational matrix for PostgreSQL.
| # | Operation / Action | SQL / CLI Syntax | Description |
|---|---|---|---|
| 1 | Start Service | pg_ctl -D /var/lib/postgresql/data start | Boots PostgreSQL postmaster process. |
| 2 | Stop Service | pg_ctl -D /var/lib/postgresql/data stop -m fast | Safely shuts down database instance. |
| 3 | Interactive CLI | psql -U postgres -d enterprise_db | Connects to transactional database. |
| 4 | Backup Database | pg_dump -Fc -v enterprise_db -f backup.dump | Generates compressed custom archive. |
| 5 | Restore Database | pg_restore -d enterprise_db backup.dump | Restores archive into target DB. |
| 6 | Vacuum Maintenance | VACUUM ANALYZE VERBOSE; | Reclaims space and updates stats. |
| 7 | Reindex Tables | REINDEX DATABASE CONCURRENTLY enterprise_db; | Rebuilds bloated database indexes. |
| 8 | List Active Queries | SELECT pid, query, state FROM pg_stat_activity; | Inspects running database operations. |
| 9 | Terminate Query | SELECT pg_cancel_backend(pid); | Stops a long-running transaction. |
| 10 | Create Role | CREATE ROLE app_user WITH LOGIN PASSWORD 'secure'; | Provisions a new database login. |
| 11 | Grant Privileges | GRANT ALL PRIVILEGES ON DATABASE enterprise_db TO app_user; | Assigns complete access rights. |
| 12 | Create Database | CREATE DATABASE enterprise_db ENCODING 'UTF8'; | Provisions new transactional DB. |
| 13 | Drop Database | DROP DATABASE IF EXISTS enterprise_db; | Deletes database instance. |
| 14 | Explain Query Plan | EXPLAIN ANALYZE SELECT * FROM users; | Evaluates execution plan performance. |
| 15 | Check Table Sizes | SELECT pg_size_pretty(pg_total_relation_size('users')); | Calculates total table disk usage. |
| 16 | Show Configuration | SHOW max_connections; | Inspects server runtime parameter. |
| 17 | Reload Config | SELECT pg_reload_conf(); | Reloads postgresql.conf changes. |
| 18 | Create Extension | CREATE EXTENSION IF NOT EXISTS "uuid-ossp"; | Provisions cryptographic extension. |
| 19 | List Extensions | SELECT * FROM pg_available_extensions; | Inspects installed modules. |
| 20 | Check Replication Lag | SELECT client_addr, write_lag FROM pg_stat_replication; | Monitors standby sync delay. |
| 21 | Create Table Partition | CREATE TABLE logs_y2026m07 PARTITION OF logs FOR VALUES FROM ('2026-07-01') TO ('2026-08-01'); | Provisions time-series partition. |
| 22 | Alter Table Schema | ALTER TABLE users ADD COLUMN email_verified BOOLEAN DEFAULT FALSE; | Modifies physical table schema. |
| 23 | Create Index | CREATE INDEX CONCURRENTLY idx_users_email ON users(email); | Builds index without locking table. |
| 24 | Analyze Dead Tuples | SELECT schemaname, relname, n_dead_tup FROM pg_stat_user_tables; | Checks table bloat status. |
| 25 | Check Lock Contention | SELECT * FROM pg_locks l JOIN pg_stat_activity a ON l.pid = a.pid; | Inspects blocking locks. |
| 26 | Set Statement Timeout | SET statement_timeout = '30s'; | Enforces query execution limit. |
| 27 | Create Schema | CREATE SCHEMA staging; | Provisions logical namespace. |
| 28 | Show Disk Usage | SELECT pg_size_pretty(pg_database_size('enterprise_db')); | Measures total database storage. |
| 29 | Verify Checkpoints | CHECKPOINT; | Forces immediate dirty buffer flush. |
| 30 | Cluster Table | CLUSTER users USING users_pkey; | Physically reorders table by index. |
| 31 | Kill Backend Process | SELECT pg_terminate_backend(pid); | Hard-terminates connection and transaction immediately. |
| 32 | Rotate Log Files | SELECT pg_rotate_logfile(); | Forces PostgreSQL logger to switch to new log file. |
| 33 | Promote Standby Server | pg_ctl promote -D /var/lib/postgresql/data | Promotes read-only standby node to primary master. |
| 34 | Pause WAL Replay | SELECT pg_wal_replay_pause(); | Pauses WAL recovery on standby replica server. |
| 35 | Resume WAL Replay | SELECT pg_wal_replay_resume(); | Resumes WAL recovery replay on standby replica. |
| 36 | Check WAL Replay Status | SELECT pg_is_wal_replay_paused(); | Checks if WAL replay is currently paused on standby. |
| 37 | Get Physical WAL Position | SELECT pg_current_wal_lsn(); | Returns current write-ahead log byte LSN location. |
| 38 | Create Replication Slot | SELECT * FROM pg_create_physical_replication_slot('standby_1'); | Provisions streaming replication slot. |
| 39 | Drop Replication Slot | SELECT pg_drop_replication_slot('standby_1'); | Deletes physical streaming replication slot. |
| 40 | List Replication Slots | SELECT * FROM pg_replication_slots; | Inspects active logical and physical replication slots. |
| 41 | Create Logical Replication Slot | SELECT * FROM pg_create_logical_replication_slot('sub_1', 'pgoutput'); | Provisions logical decoding slot for CDC. |
| 42 | Create Publication | CREATE PUBLICATION app_pub FOR TABLE users, orders; | Provisions publication for logical CDC streaming. |
| 43 | Alter Publication | ALTER PUBLICATION app_pub ADD TABLE products; | Adds table to logical replication publication. |
| 44 | Drop Publication | DROP PUBLICATION app_pub; | Removes logical replication publication. |
| 45 | Create Subscription | CREATE SUBSCRIPTION app_sub CONNECTION 'host=10.0.0.1 dbname=enterprise_db' PUBLICATION app_pub; | Provisions logical subscription node. |
| 46 | Alter Subscription | ALTER SUBSCRIPTION app_sub REFRESH PUBLICATION; | Refreshes publication schema on subscriber node. |
| 47 | Drop Subscription | DROP SUBSCRIPTION app_sub; | Removes logical replication subscription. |
| 48 | Vacuum Full Table | VACUUM FULL VERBOSE users; | Locks table and rebuilds physical relation storage. |
| 49 | Analyze Specific Table | ANALYZE VERBOSE users; | Gathers column statistics for specific table. |
| 50 | List Database Users | SELECT usename, valuntil FROM pg_user; | Inspects database accounts and password expiry dates. |
| 51 | Change User Password | ALTER USER app_user WITH PASSWORD 'NewSecurePass123!'; | Updates authentication password for database user. |
| 52 | Lock User Account | ALTER ROLE app_user NOLOGIN; | Disables login privileges for a role. |
| 53 | Unlock User Account | ALTER ROLE app_user LOGIN; | Enables login privileges for a role. |
| 54 | Grant Schema Usage | GRANT USAGE ON SCHEMA staging TO app_user; | Grants namespace usage access to role. |
| 55 | Grant Table Select | GRANT SELECT, INSERT ON ALL TABLES IN SCHEMA public TO app_user; | Grants table access rights in schema. |
| 56 | Revoke Table Privileges | REVOKE ALL PRIVILEGES ON TABLE users FROM app_user; | Removes table permissions from role. |
| 57 | Set Default Privileges | ALTER DEFAULT PRIVILEGES IN SCHEMA public GRANT SELECT ON TABLES TO app_user; | Enforces automatic grants on future tables. |
| 58 | Show Connection Limit | SHOW max_connections; | Displays max allowed concurrent client connections. |
| 59 | Set Work Memory | SET work_mem = '64MB'; | Increases per-operation sort and hash memory for session. |
| 60 | Set Maintenance Work Memory | SET maintenance_work_mem = '512MB'; | Increases RAM for VACUUM, CREATE INDEX, and ALTER TABLE. |
| 61 | Show Shared Buffers | SHOW shared_buffers; | Displays RAM size allocated for shared buffer cache. |
| 62 | Check Cache Hit Ratio | SELECT sum(heap_blks_hit) / (sum(heap_blks_hit) + sum(heap_blks_read)) FROM pg_statio_user_tables; | Calculates database buffer cache hit ratio. |
| 63 | Check Index Hit Ratio | SELECT sum(idx_blks_hit) / (sum(idx_blks_hit) + sum(idx_blks_read)) FROM pg_statio_user_indexes; | Calculates index buffer cache hit ratio. |
| 64 | List Unused Indexes | SELECT relname, indexrelname, idx_scan FROM pg_stat_user_indexes WHERE idx_scan = 0; | Identifies candidates for index removal. |
| 65 | List Duplicate Indexes | SELECT pg_size_pretty(sum(pg_relation_size(idx))) FROM pg_stat_user_indexes; | Inspects memory overhead of secondary indexes. |
| 66 | Drop Index | DROP INDEX CONCURRENTLY idx_users_email; | Removes index without locking concurrent writes. |
| 67 | Create Partial Index | CREATE INDEX idx_active_users ON users(id) WHERE status = 'active'; | Builds filtered index for active rows only. |
| 68 | Create Expression Index | CREATE INDEX idx_lower_email ON users(LOWER(email)); | Builds index on functional string transformation. |
| 69 | Create GIN Index | CREATE INDEX idx_data_gin ON log_entries USING GIN(payload); | Provisions Generalized Inverted Index for JSONB. |
| 70 | Create GiST Index | CREATE INDEX idx_geom_gist ON locations USING GIST(geom); | Provisions Generalized Search Tree for PostGIS geometries. |
| 71 | Create BRIN Index | CREATE INDEX idx_created_brin ON timeseries USING BRIN(created_at); | Provisions Block Range Index for append-only data. |
| 72 | Check Table Bloat | SELECT schemaname, tblname, bs*tblpages AS real_size FROM pg_tables; | Estimates physical relation storage bloat. |
| 73 | List Prepared Transactions | SELECT * FROM pg_prepared_xacts; | Inspects unresolved two-phase commit transactions. |
| 74 | Rollback Prepared Transaction | ROLLBACK PREPARED 'gid_12345'; | Aborts an orphaned 2PC transaction. |
| 75 | Commit Prepared Transaction | COMMIT PREPARED 'gid_12345'; | Finalizes a 2PC transaction. |
| 76 | Create Tablespace | CREATE TABLESPACE fast_ssd LOCATION '/mnt/disks/ssd1'; | Provisions physical storage tablespace. |
| 77 | Move Table to Tablespace | ALTER TABLE users SET TABLESPACE fast_ssd; | Migrates physical table storage to new disk. |
| 78 | Move Index to Tablespace | ALTER INDEX idx_users_email SET TABLESPACE fast_ssd; | Migrates index storage to new disk. |
| 79 | Drop Tablespace | DROP TABLESPACE fast_ssd; | Deletes empty storage tablespace. |
| 80 | Check Table Locks | SELECT relation::regclass, mode, granted FROM pg_locks WHERE NOT granted; | Lists queries waiting for table locks. |
| 81 | Set Lock Timeout | SET lock_timeout = '5s'; | Aborts statement if lock cannot be acquired in 5s. |
| 82 | Set Idle In Transaction Timeout | SET idle_in_transaction_session_timeout = '10s'; | Terminates sessions idling inside open transaction. |
| 83 | Create Foreign Data Wrapper | CREATE EXTENSION postgres_fdw; | Installs extension for querying external DBs. |
| 84 | Create Foreign Server | CREATE SERVER remote_pg FOREIGN DATA WRAPPER postgres_fdw OPTIONS (host '10.0.0.2', dbname 'remote_db'); | Defines remote server endpoint. |
| 85 | Create User Mapping | CREATE USER MAPPING FOR local_user SERVER remote_pg OPTIONS (user 'remote_user', password 'pass'); | Maps local role to remote server login. |
| 86 | Import Foreign Schema | IMPORT FOREIGN SCHEMA public FROM SERVER remote_pg INTO remote_staging; | Bulk imports remote table definitions. |
| 87 | Create Materialized View | CREATE MATERIALIZED VIEW mv_user_stats AS SELECT dept, COUNT(*) FROM users GROUP BY dept; | Provisions disk-backed view snapshot. |
| 88 | Refresh Materialized View | REFRESH MATERIALIZED VIEW CONCURRENTLY mv_user_stats; | Refreshes view data without blocking queries. |
| 89 | Drop Materialized View | DROP MATERIALIZED VIEW mv_user_stats; | Removes materialized view. |
| 90 | Create Event Trigger | CREATE EVENT TRIGGER ddl_logger ON ddl_command_start EXECUTE FUNCTION log_ddl(); | Fires function on DDL schema changes. |
| 91 | Disable Event Trigger | ALTER EVENT TRIGGER ddl_logger DISABLE; | Deactivates DDL event trigger. |
| 92 | Drop Event Trigger | DROP EVENT TRIGGER ddl_logger; | Deletes DDL event trigger. |
| 93 | List Database Triggers | SELECT tgname, relname FROM pg_trigger t JOIN pg_class r ON t.tgrelid = r.oid; | Lists active table triggers. |
| 94 | Disable Table Triggers | ALTER TABLE users DISABLE TRIGGER ALL; | Disables trigger execution during bulk load. |
| 95 | Enable Table Triggers | ALTER TABLE users ENABLE TRIGGER ALL; | Re-enables table trigger execution. |
| 96 | Create Advisory Lock | SELECT pg_advisory_lock(123456); | Acquires application-level lock ID. |
| 97 | Release Advisory Lock | SELECT pg_advisory_unlock(123456); | Releases application-level lock ID. |
| 98 | Unlock All Advisory Locks | SELECT pg_advisory_unlock_all(); | Releases all held session advisory locks. |
| 99 | Dump Schema Only | pg_dump -s -d enterprise_db -f schema.sql | Exports database structure without table data. |
| 100 | Dump Data Only | pg_dump -a -d enterprise_db -f data.sql | Exports table data rows without DDL schema. |
| 101 | Check Table Fillfactor | SELECT relname, reloptions FROM pg_class WHERE reloptions IS NOT NULL; | Inspects custom storage fillfactor settings. |
| 102 | Set Table Fillfactor | ALTER TABLE users SET (fillfactor = 80); | Leaves 20% free space per page for HOT updates. |
| 103 | Check HOT Updates Ratio | SELECT n_tup_upd, n_tup_hot_upd FROM pg_stat_user_tables; | Measures Heap-Only Tuple update efficiency. |
| 104 | Check WAL Disk Usage | SELECT pg_size_pretty(sum(size)) FROM pg_ls_waldir(); | Calculates disk space consumed by WAL files. |
| 105 | Force Log Rotation | SELECT pg_rotate_logfile(); | Forces database log file rotation. |
| 106 | Check Foreign Key Indexes | SELECT conname, conrelid::regclass FROM pg_constraint WHERE contype = 'f'; | Lists foreign keys to verify indexing. |
| 107 | Check Table Toast Size | SELECT pg_size_pretty(pg_relation_size(reltoastrelid)) FROM pg_class WHERE relname = 'users'; | Calculates TOAST out-of-line storage size. |
| 108 | Check Database Encoding | SELECT datname, pg_encoding_to_char(encoding) FROM pg_database; | Inspects database character encoding. |
| 109 | Check Active Extensions Version | SELECT extname, extversion FROM pg_extension; | Lists installed extensions and versions. |
| 110 | Set Session Timezone | SET TIME ZONE 'UTC'; | Sets active session time zone to UTC. |
| 111 | Show Active Timezone | SHOW TIMEZONE; | Outputs current session time zone. |
| 112 | Check Database Collation | SELECT datname, datcollate FROM pg_database; | Inspects character collation order. |
| 113 | Check Background Writer Stats | SELECT * FROM pg_stat_bgwriter; | Monitors checkpoint and bgwriter buffer flushes. |
| 114 | Check Buffer Pool Usage per Table | SELECT c.relname, count(*) AS buffers FROM pg_buffercache b JOIN pg_class c ON b.relfilenode = c.relfilenode GROUP BY c.relname; | Inspects shared buffers usage per table. |
| 115 | Check Sequence Current Value | SELECT last_value FROM user_id_seq; | Inspects current sequence counter value. |
| 116 | Set Sequence Value | SELECT setval('user_id_seq', 5000); | Updates sequence counter value. |
| 117 | Check Table Storage Encodings | SELECT attname, attstorage FROM pg_attribute WHERE attrelid = 'users'::regclass; | Inspects TOAST compression modes (PLAIN, EXTENDED, MAIN). |
| 118 | Set Column Storage Compression | ALTER TABLE users ALTER COLUMN payload SET STORAGE EXTENDED; | Enforces main and TOAST storage compression. |
| 119 | Check Auto-vacuum Activity | SELECT * FROM pg_stat_progress_vacuum; | Monitors active running vacuum jobs. |
| 120 | Check CREATE INDEX Progress | SELECT * FROM pg_stat_progress_create_index; | Monitors progress of concurrent index builds. |
| 121 | Check ANALYZE Progress | SELECT * FROM pg_stat_progress_analyze; | Monitors active table analyze jobs. |
| 122 | Check CLUSTER Progress | SELECT * FROM pg_stat_progress_cluster; | Monitors active cluster/vacuum full jobs. |
| 123 | Set Autovacuum Scale Factor | ALTER TABLE users SET (autovacuum_vacuum_scale_factor = 0.05); | Triggers vacuum when 5% rows change. |
| 124 | Set Autovacuum Threshold | ALTER TABLE users SET (autovacuum_vacuum_threshold = 100); | Sets base dead tuple threshold for vacuum. |
| 125 | Check Replication Slot Lag | SELECT slot_name, pg_wal_lsn_diff(pg_current_wal_lsn(), restart_lsn) FROM pg_replication_slots; | Calculates LSN lag bytes for replication slots. |
| 126 | Get Transaction ID Age | SELECT datname, age(datfrozenxid) FROM pg_database; | Monitors transaction ID wraparound age. |
| 127 | Check Multixact Age | SELECT datname, mxid_age(datminmxid) FROM pg_database; | Monitors multixact ID wraparound age. |
| 128 | Set Statement Timeout Global | ALTER DATABASE enterprise_db SET statement_timeout = '60s'; | Caps statement execution time globally. |
| 129 | Set Idle In Transaction Timeout Global | ALTER DATABASE enterprise_db SET idle_in_transaction_session_timeout = '30s'; | Caps idle transaction time globally. |
| 130 | Check Server Version | SELECT version(); | Outputs running PostgreSQL release and build version. |
| 131 | Check Index Usage Details | SELECT schemaname, relname, indexrelname, idx_scan, idx_tup_read, idx_tup_fetch FROM pg_stat_user_indexes; | Inspects index scan efficiency. |
| 132 | Check Table I/O Statistics | SELECT schemaname, relname, heap_blks_read, heap_blks_hit FROM pg_statio_user_tables; | Measures table buffer cache hit ratio. |
| 133 | Check Index I/O Statistics | SELECT schemaname, relname, indexrelname, idx_blks_read, idx_blks_hit FROM pg_statio_user_indexes; | Measures index buffer cache hit ratio. |
| 134 | Check Database Size Bytes | SELECT pg_database_size('enterprise_db'); | Outputs exact database size in bytes. |
| 135 | Check Table Size Bytes | SELECT pg_relation_size('users'); | Outputs table data size in bytes without indexes. |
| 136 | Check Total Relation Size Bytes | SELECT pg_total_relation_size('users'); | Outputs table data plus index size in bytes. |
| 137 | Check Index Size Bytes | SELECT pg_relation_size('idx_users_email'); | Outputs index size in bytes. |
| 138 | Check TOAST Size Bytes | SELECT pg_total_relation_size(reltoastrelid) FROM pg_class WHERE relname='users'; | Outputs TOAST table size in bytes. |
| 139 | Check System Catalogs List | SELECT relname FROM pg_class WHERE relnamespace='pg_catalog'::regnamespace AND relkind='r'; | Lists PostgreSQL system catalog tables. |
| 140 | Check System Views List | SELECT viewname FROM pg_views WHERE schemaname='pg_catalog'; | Lists PostgreSQL system catalog views. |
| 141 | Check Active Replication Origins | SELECT * FROM pg_replication_origin_status; | Inspects active logical replication origin LSNs. |
| 142 | Create Replication Origin | SELECT pg_replication_origin_create('origin1'); | Provisions logical replication origin slot. |
| 143 | Drop Replication Origin | SELECT pg_replication_origin_drop('origin1'); | Deletes logical replication origin slot. |
| 144 | Check Extension Commands | SELECT * FROM pg_available_extension_versions WHERE name='uuid-ossp'; | Inspects available versions of extension. |
| 145 | Alter Extension Update | ALTER EXTENSION "uuid-ossp" UPDATE TO '1.1'; | Upgrades extension version in active database. |
| 146 | Drop Extension | DROP EXTENSION IF EXISTS "uuid-ossp"; | Removes extension from database. |
| 147 | Check Setting Source | SELECT name, setting, source FROM pg_settings WHERE source <> 'default'; | Lists non-default server parameters. |
| 148 | Set Parameter Session Local | SET LOCAL work_mem = '128MB'; | Sets parameter for duration of active transaction. |
| 149 | Reset Parameter Session | RESET work_mem; | Restores parameter to default setting. |
| 150 | Reset All Session Parameters | RESET ALL; | Restores all session parameters to default settings. |
| 151 | Check User Roles Membership | SELECT r.rolname, m.roleid::regrole FROM pg_roles r JOIN pg_auth_members m ON r.oid=m.member; | Lists role memberships. |
| 152 | Grant Role to Role | GRANT data_analyst TO app_user; | Assigns role permissions to user account. |
| 153 | Revoke Role from Role | REVOKE data_analyst FROM app_user; | Revokes role permissions from user account. |
| 154 | Check Default Privileges List | SELECT * FROM pg_default_acl; | Lists schema-level default access control settings. |
| 155 | Check Database Triggers List | SELECT tgname, relname FROM pg_trigger JOIN pg_class ON pg_trigger.tgrelid=pg_class.oid; | Lists active database triggers. |
| 156 | Check Database Locks Summary | SELECT mode, count(*) FROM pg_locks GROUP BY mode; | Groups active locks by lock mode. |
| 157 | Check Database Process Memory | SELECT pid, usename, query, state FROM pg_stat_activity WHERE state <> 'idle'; | Inspects active processing backends. |
| 158 | Check Database Transaction Age | SELECT datname, age(datfrozenxid) FROM pg_database WHERE datname='enterprise_db'; | Monitors database transaction ID age. |
| 159 | Check Multixact ID Age | SELECT datname, mxid_age(datminmxid) FROM pg_database WHERE datname='enterprise_db'; | Monitors database multixact ID age. |
| 160 | Check Log File Directory | SELECT pg_ls_dir('log'); | Lists log file names in log directory. |
| 161 | Read Log File Portion | SELECT pg_read_file('postgresql.log', 0, 1000); | Reads raw text segment from log file. |
| 162 | Check Stat Clear Snapshot | SELECT pg_stat_clear_snapshot(); | Flushes cached statistics snapshot. |
| 163 | Check Stat Reset | SELECT pg_stat_reset(); | Resets server-wide statistics counters. |
| 164 | Check Stat Reset Shared | SELECT pg_stat_reset_shared('bgwriter'); | Resets shared subsystem statistics counters. |
| 165 | Check Database System Identifier | SELECT system_identifier FROM pg_control_system(); | Outputs unique system cluster ID. |
| 166 | Check Database Control File State | SELECT state, checkpoint_lsn FROM pg_control_checkpoint(); | Inspects control file state and last LSN. |
| 167 | Check Database Recovery Status | SELECT pg_is_in_recovery(); | Returns true if database is running in standby/recovery mode. |
| 168 | Check Database Last WAL Receive LSN | SELECT pg_last_wal_receive_lsn(); | Outputs LSN location of last WAL received by standby. |
| 169 | Check Database Last WAL Replay LSN | SELECT pg_last_wal_replay_lsn(); | Outputs LSN location of last WAL replayed by standby. |
| 170 | Check Database Last WAL Replay Time | SELECT pg_last_xact_replay_timestamp(); | Outputs timestamp of last transaction replayed by standby. |
| 171 | Check Database WAL Keep Segments | SHOW wal_keep_size; | Inspects WAL retain size setting for replication. |
| 172 | Set Database WAL Keep Segments | ALTER SYSTEM SET wal_keep_size = '10GB'; | Sets 10GB WAL retain threshold for standby sync. |
| 173 | Check Database Max WAL Size | SHOW max_wal_size; | Inspects max WAL size setting before checkpoint. |
| 174 | Set Database Max WAL Size | ALTER SYSTEM SET max_wal_size = '16GB'; | Configures 16GB max WAL size before checkpoint. |
| 175 | Check Database Min WAL Size | SHOW min_wal_size; | Inspects minimum retained WAL size. |
| 176 | Check Database Checkpoint Timeout | SHOW checkpoint_timeout; | Inspects automatic checkpoint time window. |
| 177 | Set Database Checkpoint Timeout | ALTER SYSTEM SET checkpoint_timeout = '15min'; | Sets 15-minute automatic checkpoint interval. |
| 178 | Check Database Checkpoint Completion Target | SHOW checkpoint_completion_target; | Inspects checkpoint write spread factor. |
| 179 | Set Database Checkpoint Completion Target | ALTER SYSTEM SET checkpoint_completion_target = 0.9; | Spreads checkpoint I/O over 90% of window. |
| 180 | Check Database Archive Mode | SHOW archive_mode; | Inspects continuous WAL archive mode. |
| 181 | Check Database Archive Command | SHOW archive_command; | Inspects script command used for WAL archiving. |
| 182 | Check Database Archive Timeout | SHOW archive_timeout; | Inspects maximum duration before forcing WAL archive segment. |
| 183 | Set Database Archive Timeout | ALTER SYSTEM SET archive_timeout = '300s'; | Forces WAL segment archive every 5 minutes. |
| 184 | Check Database Archive Status | SELECT * FROM pg_stat_archiver; | Monitors total archived and failed WAL segments. |
| 185 | Check Database SSL Status | SHOW ssl; | Returns on/off for SSL connection encryption. |
| 186 | Check Database SSL Ciphers | SHOW ssl_ciphers; | Lists active SSL cipher algorithms. |
| 187 | Check Database Password Encryption | SHOW password_encryption; | Inspects password hashing algorithm (scram-sha-256). |
| 188 | Check Database Client Encoding | SHOW client_encoding; | Displays active client character encoding. |
| 189 | Set Database Client Encoding | SET client_encoding = 'UTF8'; | Configures client character encoding. |
| 190 | Check Database Server Version String | SELECT version(); | Outputs complete version, compiler, and build architecture string. |
| 191 | Check Database Ping Connection | SELECT 1; | Simple database ping test returning 1. |
| 192 | Check Database Current Date | SELECT CURRENT_DATE; | Returns current server date. |
| 193 | Check Database Current Time | SELECT CURRENT_TIME; | Returns current server time with timezone. |
| 194 | Check Database Current Timestamp | SELECT CURRENT_TIMESTAMP; | Returns current server timestamp. |
| 195 | Check Database Session User | SELECT SESSION_USER; | Returns session user account. |
| 196 | Check Database Current User | SELECT CURRENT_USER; | Returns current execution user account. |
| 197 | Check Database Current Schema | SELECT CURRENT_SCHEMA(); | Returns current active schema name. |
| 198 | Check Database Current Search Path | SHOW search_path; | Displays active schema search path. |
| 199 | Set Database Search Path | SET search_path TO staging, public; | Configures active schema search path. |
| 200 | Check Database Uptime | SELECT pg_postmaster_start_time(); | Outputs exact postmaster startup timestamp. |
MySQL Enterprise OLTP
Technical Architecture & Overview
MySQL Enterprise is the industry's premier open-source relational database management system, powered by the ACID-compliant InnoDB storage engine. It features thread-based concurrency, pluggable storage engines (InnoDB, NDB Cluster, Memory), and robust high-availability architectures (Group Replication, InnoDB Cluster, Source-Replica GTID replication).
Primary Use Cases: High-volume web applications, e-commerce transaction processing, SaaS backends, scale-out read-heavy microservices, and managed cloud OLTP databases.
Core Components: SQL Parser/Optimizer, InnoDB Buffer Pool, Redo Log, Undo Log, Doublewrite Buffer, Adaptive Hash Index, and Binary Logs (GTID CDC).
Exhaustive 200-command administrative, diagnostic, and operational matrix for MySQL Enterprise.
| # | Operation / Action | SQL / CLI Syntax | Description |
|---|---|---|---|
| 1 | Start Daemon | sudo systemctl start mysqld | Starts MySQL server daemon. |
| 2 | Stop Daemon | sudo systemctl stop mysqld | Stops MySQL server daemon. |
| 3 | Interactive Shell | mysql -u root -p | Opens administrative SQL monitor. |
| 4 | Full Database Backup | mysqldump -u root -p --all-databases > backup.sql | Exports entire cluster data dump. |
| 5 | Restore Database | mysql -u root -p enterprise_db < backup.sql | Restores SQL dump file. |
| 6 | InnoDB Status Check | SHOW ENGINE INNODB STATUS\G | Inspects storage engine metrics. |
| 7 | Process List Inspection | SHOW FULL PROCESSLIST; | Views active query threads. |
| 8 | Kill Process Thread | KILL 4512; | Terminates hung query thread. |
| 9 | Create User Account | CREATE USER 'app'@'localhost' IDENTIFIED BY 'Pass!'; | Provisions new MySQL user. |
| 10 | Grant Privileges | GRANT ALL PRIVILEGES ON enterprise_db.* TO 'app'@'localhost'; | Assigns database access. |
| 11 | Flush Tables | FLUSH TABLES WITH READ LOCK; | Locks all tables for backup. |
| 12 | Release Read Locks | UNLOCK TABLES; | Releases table locks. |
| 13 | Analyze Table | ANALYZE TABLE users; | Updates index cardinality stats. |
| 14 | Optimize Table | OPTIMIZE TABLE users; | Defragments InnoDB table space. |
| 15 | Check Table Integrity | CHECK TABLE users; | Scans table for corruption. |
| 16 | Show Global Status | SHOW GLOBAL STATUS LIKE 'Conn%'; | Inspects connection metrics. |
| 17 | Show Global Variables | SHOW VARIABLES LIKE 'innodb_buffer_pool_size'; | Inspects memory configurations. |
| 18 | Explain Query Execution | EXPLAIN FORMAT=JSON SELECT * FROM users; | Performs deep query analysis. |
| 19 | Create Database | CREATE DATABASE enterprise_db CHARACTER SET utf8mb4; | Provisions new database. |
| 20 | Drop Database | DROP DATABASE enterprise_db; | Deletes database instance. |
| 21 | Check Replication Status | SHOW REPLICA STATUS\G | Inspects replica lag and sync. |
| 22 | Reset Replica | RESET REPLICA ALL; | Clears replication configuration. |
| 23 | Change Master Replica | CHANGE REPLICATION SOURCE TO SOURCE_HOST='10.0.0.5'; | Sets replication upstream host. |
| 24 | Create Index | ALTER TABLE users ADD INDEX idx_email (email); | Provisions new table index. |
| 25 | Drop Index | ALTER TABLE users DROP INDEX idx_email; | Removes table index. |
| 26 | Flush Query Cache | RESET QUERY CACHE; | Clears memory query cache. |
| 27 | Show Master Logs | SHOW BINARY LOGS; | Lists active binary log files. |
| 28 | Purge Binary Logs | PURGE BINARY LOGS BEFORE '2026-06-01 00:00:00'; | Removes old binlog files. |
| 29 | Set Global Variable | SET GLOBAL max_connections = 500; | Modifies runtime configuration. |
| 30 | Check Disk Storage | SELECT table_schema, SUM(data_length + index_length) FROM information_schema.tables GROUP BY table_schema; | Calculates database storage sizes. |
| 31 | Start Replica Thread | START REPLICA; | Starts SQL and IO replication threads. |
| 32 | Stop Replica Thread | STOP REPLICA; | Stops SQL and IO replication threads. |
| 33 | Show Master Status | SHOW BINARY LOG STATUS; | Inspects active binlog filename and offset position. |
| 34 | Flush Privileges | FLUSH PRIVILEGES; | Reloads grant tables from mysql database. |
| 35 | Flush Logs | FLUSH LOGS; | Flushes error log, binlog, and relay logs. |
| 36 | Flush Status | FLUSH STATUS; | Resets status variables to zero. |
| 37 | Show Engine Status | SHOW ENGINE PERFORMANCE_SCHEMA STATUS; | Inspects performance schema status. |
| 38 | Show Open Tables | SHOW OPEN TABLES WHERE In_use > 0; | Lists tables currently locked by queries. |
| 39 | Show Table Status | SHOW TABLE STATUS FROM enterprise_db; | Pulls rows, data length, and engine types. |
| 40 | Set Password Expiry | ALTER USER 'app'@'localhost' PASSWORD EXPIRE INTERVAL 90 DAY; | Enforces password rotation policy. |
| 41 | Lock User Account | ALTER USER 'app'@'localhost' ACCOUNT LOCK; | Disables user authentication. |
| 42 | Unlock User Account | ALTER USER 'app'@'localhost' ACCOUNT UNLOCK; | Enables user authentication. |
| 43 | Show User Grants | SHOW GRANTS FOR 'app'@'localhost'; | Lists all assigned permissions for user. |
| 44 | Revoke Privileges | REVOKE ALL PRIVILEGES ON enterprise_db.* FROM 'app'@'localhost'; | Removes permissions from user. |
| 45 | Create Role | CREATE ROLE 'app_read_only'; | Provisions role container in MySQL. |
| 46 | Grant Role to User | GRANT 'app_read_only' TO 'app'@'localhost'; | Assigns role to user account. |
| 47 | Set Default Role | SET DEFAULT ROLE ALL TO 'app'@'localhost'; | Activates roles on user login. |
| 48 | Drop Role | DROP ROLE 'app_read_only'; | Removes role container. |
| 49 | Show Binary Log Events | SHOW BINLOG EVENTS IN 'binlog.000001' LIMIT 10; | Inspects specific transaction log events. |
| 50 | Set GTID Mode | SET GLOBAL gtid_mode = ON_PERMISSIVE; | Enables Global Transaction Identifier mode. |
| 51 | Check GTID Executed | SELECT @@GLOBAL.gtid_executed; | Inspects list of executed GTID transactions. |
| 52 | Set InnoDB Buffer Pool Size | SET GLOBAL innodb_buffer_pool_size = 8589934592; | Adjusts InnoDB buffer pool RAM size. |
| 53 | Set InnoDB Log File Size | SET GLOBAL innodb_redo_log_capacity = 2147483648; | Adjusts redo log capacity size. |
| 54 | Check InnoDB Lock Waits | SELECT * FROM performance_schema.data_lock_waits; | Inspects blocking transaction lock waits. |
| 55 | Check InnoDB Data Locks | SELECT * FROM performance_schema.data_locks; | Inspects active row and table locks. |
| 56 | Check InnoDB Metrics | SELECT * FROM information_schema.INNODB_METRICS WHERE status='enabled'; | Pulls internal engine telemetry counters. |
| 57 | Enable InnoDB Metric | SET GLOBAL innodb_cmp_per_index_enabled = ON; | Activates per-index compression metrics. |
| 58 | Set Slow Query Log | SET GLOBAL slow_query_log = 'ON'; | Activates slow query logging. |
| 59 | Set Long Query Time | SET GLOBAL long_query_time = 2.0; | Log queries taking longer than 2 seconds. |
| 60 | Set Log Queries Not Using Indexes | SET GLOBAL log_queries_not_using_indexes = ON; | Logs queries missing index execution. |
| 61 | Set Read Only Mode | SET GLOBAL read_only = ON; | Blocks writes for non-superusers. |
| 62 | Set Super Read Only Mode | SET GLOBAL super_read_only = ON; | Blocks writes for all users including root. |
| 63 | Disable Read Only Mode | SET GLOBAL read_only = OFF; | Enables database write operations. |
| 64 | Check System Variables | SHOW VARIABLES LIKE 'max_allowed_packet'; | Inspects maximum packet size parameter. |
| 65 | Set Max Connection Timeout | SET GLOBAL wait_timeout = 600; | Closes non-interactive client connections after 10m. |
| 66 | Create Partitioned Table | CREATE TABLE logs (id INT, dt DATE) PARTITION BY RANGE (YEAR(dt)) (PARTITION p2026 VALUES LESS THAN (2027)); | Provisions range-partitioned table. |
| 67 | Add Table Partition | ALTER TABLE logs ADD PARTITION (PARTITION p2027 VALUES LESS THAN (2028)); | Appends new range partition to table. |
| 68 | Drop Table Partition | ALTER TABLE logs DROP PARTITION p2026; | Purges partition data instantly. |
| 69 | Truncate Table Partition | ALTER TABLE logs TRUNCATE PARTITION p2027; | Clears partition records. |
| 70 | Check Partition Info | SELECT PARTITION_NAME, TABLE_ROWS FROM information_schema.PARTITIONS WHERE TABLE_NAME='logs'; | Inspects table partition sizes. |
| 71 | Create Spatial Index | ALTER TABLE locations ADD SPATIAL INDEX idx_geo (coords); | Provisions R-Tree index for spatial data. |
| 72 | Create Fulltext Index | ALTER TABLE articles ADD FULLTEXT INDEX idx_ft (content); | Provisions inverted index for text search. |
| 73 | Run Fulltext Query | SELECT * FROM articles WHERE MATCH(content) AGAINST('database' IN BOOLEAN MODE); | Executes fulltext search query. |
| 74 | Check Table Column Types | DESCRIBE users; | Outputs table column definitions. |
| 75 | Rename Table | RENAME TABLE users TO app_users; | Renames table relation in database. |
| 76 | Add Foreign Key | ALTER TABLE orders ADD CONSTRAINT fk_user FOREIGN KEY (user_id) REFERENCES users(id); | Enforces foreign key constraint. |
| 77 | Drop Foreign Key | ALTER TABLE orders DROP FOREIGN KEY fk_user; | Removes foreign key constraint. |
| 78 | Create Event Scheduler | CREATE EVENT purge_logs ON SCHEDULE EVERY 1 DAY DO DELETE FROM logs WHERE dt < NOW() - INTERVAL 30 DAY; | Provisions automated scheduled event. |
| 79 | Enable Event Scheduler | SET GLOBAL event_scheduler = ON; | Activates background event execution daemon. |
| 80 | Show Scheduled Events | SHOW EVENTS FROM enterprise_db; | Lists all configured scheduled events. |
| 81 | Drop Scheduled Event | DROP EVENT IF EXISTS purge_logs; | Removes scheduled background event. |
| 82 | Create Stored Procedure | DELIMITER // CREATE PROCEDURE CleanUsers() BEGIN DELETE FROM users WHERE active=0; END // DELIMITER ; | Provisions stored procedure routine. |
| 83 | Execute Stored Procedure | CALL CleanUsers(); | Runs stored procedure routine. |
| 84 | Drop Stored Procedure | DROP PROCEDURE IF EXISTS CleanUsers; | Deletes stored procedure. |
| 85 | Create Stored Function | CREATE FUNCTION AddTax(p DECIMAL(10,2)) RETURNS DECIMAL(10,2) DETERMINISTIC RETURN p * 1.08; | Provisions scalar user function. |
| 86 | Drop Stored Function | DROP FUNCTION IF EXISTS AddTax; | Deletes stored function. |
| 87 | Check Performance Schema Memory | SELECT * FROM performance_schema.memory_summary_global_by_event_name ORDER BY CURRENT_NUMBER_OF_BYTES_USED DESC LIMIT 10; | Analyzes memory allocation across events. |
| 88 | Check Statement Execution Stats | SELECT * FROM performance_schema.events_statements_summary_by_digest ORDER BY SUM_TIMER_WAIT DESC LIMIT 10; | Finds most resource-intensive SQL queries. |
| 89 | Check Table I/O Stats | SELECT * FROM performance_schema.table_io_waits_summary_by_table ORDER BY SUM_TIMER_WAIT DESC LIMIT 10; | Measures physical I/O latency across tables. |
| 90 | Check File I/O Stats | SELECT * FROM performance_schema.file_summary_by_event_name ORDER BY SUM_TIMER_WAIT DESC LIMIT 10; | Measures physical file I/O latency. |
| 91 | Create User Savepoint | SAVEPOINT sp1; | Sets savepoint within active transaction. |
| 92 | Rollback to Savepoint | ROLLBACK TO SAVEPOINT sp1; | Reverts transaction state back to savepoint. |
| 93 | Release Savepoint | RELEASE SAVEPOINT sp1; | Removes savepoint reference. |
| 94 | Check Transaction Isolation Level | SELECT @@transaction_isolation; | Inspects active session isolation mode. |
| 95 | Set Transaction Isolation Level | SET SESSION TRANSACTION ISOLATION LEVEL READ COMMITTED; | Configures read committed transaction isolation. |
| 96 | Check Max Allowed Packet | SELECT @@max_allowed_packet; | Inspects max network payload threshold. |
| 97 | Check Character Sets | SHOW CHARACTER SET; | Outputs supported database character sets. |
| 98 | Check Collations | SHOW COLLATION WHERE Charset='utf8mb4'; | Lists supported utf8mb4 collation orderings. |
| 99 | Verify Engine Version | SELECT VERSION(); | Outputs running MySQL engine version. |
| 100 | Shutdown Server via SQL | SHUTDOWN; | Triggers graceful server shutdown via SQL command. |
| 101 | Check InnoDB Buffer Pool Hit Rate | SELECT (1 - (SELECT VARIABLE_VALUE FROM performance_schema.global_status WHERE VARIABLE_NAME = 'Innodb_buffer_pool_reads') / (SELECT VARIABLE_VALUE FROM performance_schema.global_status WHERE VARIABLE_NAME = 'Innodb_buffer_pool_read_requests')) * 100 AS Hit_Rate; | Calculates InnoDB buffer pool hit ratio percentage. |
| 102 | Check InnoDB Redo Log Wait Rate | SHOW GLOBAL STATUS LIKE 'Innodb_log_waits'; | Measures redo log write waits. |
| 103 | Check InnoDB Lock Waiting Time | SHOW GLOBAL STATUS LIKE 'Innodb_row_lock_time_avg'; | Measures average row lock wait latency. |
| 104 | Check Table Cache Status | SHOW GLOBAL STATUS LIKE 'Open_tables'; | Inspects open table handles count. |
| 105 | Set Table Open Cache | SET GLOBAL table_open_cache = 4000; | Increases open table handle capacity. |
| 106 | Check Thread Cache Size | SHOW GLOBAL STATUS LIKE 'Threads_cached'; | Inspects cached connection threads count. |
| 107 | Set Thread Cache Size | SET GLOBAL thread_cache_size = 64; | Configures connection thread recycling capacity. |
| 108 | Check Max Execution Time | SET SESSION max_execution_time = 5000; | Caps SELECT statement execution time to 5s. |
| 109 | Check Connection Limits per User | ALTER USER 'app'@'localhost' WITH MAX_CONNECTIONS_PER_HOUR 1000; | Throttles user connections per hour. |
| 110 | Check Account Resource Limits | ALTER USER 'app'@'localhost' WITH MAX_QUERIES_PER_HOUR 50000; | Throttles total queries per hour. |
| 111 | Set Password Lifetime | ALTER USER 'app'@'localhost' PASSWORD EXPIRE INTERVAL 180 DAY; | Configures 180-day password expiration. |
| 112 | Set Password History | ALTER USER 'app'@'localhost' PASSWORD HISTORY 5; | Prevents reusing last 5 passwords. |
| 113 | Check Binary Log Expiry | SHOW VARIABLES LIKE 'binlog_expire_logs_seconds'; | Inspects automatic binlog purge window. |
| 114 | Set Binary Log Expiry | SET GLOBAL binlog_expire_logs_seconds = 604800; | Configures 7-day automatic binlog purge. |
| 115 | Check Binlog Format | SHOW VARIABLES LIKE 'binlog_format'; | Inspects replication log format (ROW, STATEMENT, MIXED). |
| 116 | Set Binlog Format Row | SET GLOBAL binlog_format = 'ROW'; | Enforces row-based replication logging. |
| 117 | Check Group Replication Status | SELECT * FROM performance_schema.replication_group_members; | Inspects active Galera/Group Replication nodes. |
| 118 | Check Group Replication Member Stats | SELECT * FROM performance_schema.replication_group_member_stats; | Monitors queue lag across group nodes. |
| 119 | Check Performance Schema Stage Progress | SELECT * FROM performance_schema.events_stages_current; | Monitors progress of ALTER TABLE / OPTIMIZE operations. |
| 120 | Check Index Usage Digest | SELECT * FROM performance_schema.schema_index_statistics; | Monitors read/write I/O per index. |
| 121 | Check Unused Indexes PS | SELECT * FROM sys.schema_unused_indexes; | Identifies candidate indexes for removal via sys schema. |
| 122 | Check Duplicate Indexes PS | SELECT * FROM sys.schema_redundant_indexes; | Identifies redundant overlapping indexes via sys schema. |
| 123 | Check Table Auto Increment Value | SELECT AUTO_INCREMENT FROM information_schema.tables WHERE table_name='users'; | Inspects current auto-increment counter. |
| 124 | Set Table Auto Increment Value | ALTER TABLE users AUTO_INCREMENT = 10000; | Resets auto-increment counter. |
| 125 | Check InnoDB Table Compression | ALTER TABLE users ROW_FORMAT=COMPRESSED KEY_BLOCK_SIZE=8; | Applies page-level compression. |
| 126 | Check Query Rewrite Plugin | SHOW PLUGINS; | Inspects installed server plugins. |
| 127 | Install Plugin | INSTALL PLUGIN audit_log SONAME 'audit_log.so'; | Installs Enterprise Audit plugin. |
| 128 | Uninstall Plugin | UNINSTALL PLUGIN audit_log; | Removes server plugin. |
| 129 | Check Engine Version Details | SELECT @@version_comment, @@version_compile_os; | Outputs OS build environment and comment. |
| 130 | Verify MySQL Uptime | SHOW GLOBAL STATUS LIKE 'Uptime'; | Displays server uptime seconds. |
| 131 | Check InnoDB Buffer Pool Instances | SHOW VARIABLES LIKE 'innodb_buffer_pool_instances'; | Inspects buffer pool shard count. |
| 132 | Check InnoDB Page Size | SHOW VARIABLES LIKE 'innodb_page_size'; | Inspects physical InnoDB page size in bytes. |
| 133 | Check InnoDB Flush Log At Trx Commit | SHOW VARIABLES LIKE 'innodb_flush_log_at_trx_commit'; | Inspects ACID redo log flush safety (0, 1, 2). |
| 134 | Set InnoDB Flush Log At Trx Commit | SET GLOBAL innodb_flush_log_at_trx_commit = 1; | Enforces strict ACID redo log disk flush on commit. |
| 135 | Check InnoDB Doublewrite Buffer | SHOW VARIABLES LIKE 'innodb_doublewrite'; | Inspects doublewrite buffer safety mode. |
| 136 | Check InnoDB File Per Table | SHOW VARIABLES LIKE 'innodb_file_per_table'; | Verifies whether each table gets its own .ibd file. |
| 137 | Check InnoDB Adaptive Hash Index | SHOW VARIABLES LIKE 'innodb_adaptive_hash_index'; | Inspects adaptive hash index state. |
| 138 | Disable InnoDB Adaptive Hash Index | SET GLOBAL innodb_adaptive_hash_index = OFF; | Disables adaptive hash index to reduce mutex contention. |
| 139 | Enable InnoDB Adaptive Hash Index | SET GLOBAL innodb_adaptive_hash_index = ON; | Activates adaptive hash index. |
| 140 | Check InnoDB Read I/O Threads | SHOW VARIABLES LIKE 'innodb_read_io_threads'; | Inspects background disk read threads. |
| 141 | Check InnoDB Write I/O Threads | SHOW VARIABLES LIKE 'innodb_write_io_threads'; | Inspects background disk write threads. |
| 142 | Check InnoDB Max Dirty Pages Pct | SHOW VARIABLES LIKE 'innodb_max_dirty_pages_pct'; | Inspects max dirty page ratio in buffer pool. |
| 143 | Check InnoDB Flush Method | SHOW VARIABLES LIKE 'innodb_flush_method'; | Inspects OS file flush method (O_DIRECT). |
| 144 | Check InnoDB IO Capacity | SHOW VARIABLES LIKE 'innodb_io_capacity'; | Inspects base I/O operations per second allocation. |
| 145 | Set InnoDB IO Capacity | SET GLOBAL innodb_io_capacity = 2000; | Increases base I/O capacity for SSD storage. |
| 146 | Check InnoDB IO Capacity Max | SHOW VARIABLES LIKE 'innodb_io_capacity_max'; | Inspects peak I/O capacity for background flushing. |
| 147 | Set InnoDB IO Capacity Max | SET GLOBAL innodb_io_capacity_max = 4000; | Increases max I/O capacity for SSD storage. |
| 148 | Check InnoDB Lock Wait Timeout | SHOW VARIABLES LIKE 'innodb_lock_wait_timeout'; | Inspects max seconds query waits for row lock. |
| 149 | Set InnoDB Lock Wait Timeout | SET GLOBAL innodb_lock_wait_timeout = 10; | Caps row lock wait duration to 10 seconds. |
| 150 | Check InnoDB Print Deadlock Logs | SHOW VARIABLES LIKE 'innodb_print_all_deadlocks'; | Inspects if all deadlocks are written to error log. |
| 151 | Enable InnoDB Print Deadlock Logs | SET GLOBAL innodb_print_all_deadlocks = ON; | Logs all transaction deadlocks to error log. |
| 152 | Check Binlog Cache Size | SHOW VARIABLES LIKE 'binlog_cache_size'; | Inspects transaction binary log buffer RAM size. |
| 153 | Check Sync Binlog | SHOW VARIABLES LIKE 'sync_binlog'; | Inspects binary log disk sync frequency (0, 1). |
| 154 | Set Sync Binlog | SET GLOBAL sync_binlog = 1; | Enforces disk sync for binary log on every transaction. |
| 155 | Check Relay Log Info | SHOW RELAYLOG EVENTS IN 'relaylog.000001' LIMIT 10; | Inspects contents of replication relay log. |
| 156 | Check Replica Parallel Workers | SHOW VARIABLES LIKE 'replica_parallel_workers'; | Inspects parallel replication applier threads. |
| 157 | Set Replica Parallel Workers | SET GLOBAL replica_parallel_workers = 8; | Enables 8 parallel worker threads for replication. |
| 158 | Check Replica Parallel Type | SHOW VARIABLES LIKE 'replica_parallel_type'; | Inspects parallel replication dependency algorithm (LOGICAL_CLOCK). |
| 159 | Set Replica Parallel Type | SET GLOBAL replica_parallel_type = 'LOGICAL_CLOCK'; | Enforces logical clock dependency parallel replication. |
| 160 | Check Replica Preserve Commit Order | SHOW VARIABLES LIKE 'replica_preserve_commit_order'; | Ensures replica commits transactions in master order. |
| 161 | Set Replica Preserve Commit Order | SET GLOBAL replica_preserve_commit_order = ON; | Enforces commit order preservation on replica. |
| 162 | Check Master Info File | SHOW VARIABLES LIKE 'master_info_repository'; | Inspects replication metadata storage (TABLE vs FILE). |
| 163 | Check Relay Log Info File | SHOW VARIABLES LIKE 'relay_log_info_repository'; | Inspects relay log metadata storage (TABLE vs FILE). |
| 164 | Check Character Set Database | SHOW VARIABLES LIKE 'character_set_database'; | Inspects active database default character set. |
| 165 | Check Collation Database | SHOW VARIABLES LIKE 'collation_database'; | Inspects active database default collation. |
| 166 | Check Character Set Server | SHOW VARIABLES LIKE 'character_set_server'; | Inspects server-wide default character set. |
| 167 | Check Collation Server | SHOW VARIABLES LIKE 'collation_server'; | Inspects server-wide default collation. |
| 168 | Set Character Set Client | SET NAMES 'utf8mb4'; | Configures client connection character set and collation. |
| 169 | Check Auto Increment Increment | SHOW VARIABLES LIKE 'auto_increment_increment'; | Inspects auto-increment step value for multi-master. |
| 170 | Check Auto Increment Offset | SHOW VARIABLES LIKE 'auto_increment_offset'; | Inspects auto-increment starting offset for multi-master. |
| 171 | Set Auto Increment Step | SET GLOBAL auto_increment_increment = 2; | Configures 2-step increment for dual-master replication. |
| 172 | Set Auto Increment Offset | SET GLOBAL auto_increment_offset = 1; | Configures offset 1 for master 1. |
| 173 | Check Max Allowed Packet | SHOW VARIABLES LIKE 'max_allowed_packet'; | Inspects maximum allowed network packet payload size. |
| 174 | Set Max Allowed Packet | SET GLOBAL max_allowed_packet = 1073741824; | Increases max packet payload size to 1GB. |
| 175 | Check Interactive Timeout | SHOW VARIABLES LIKE 'interactive_timeout'; | Inspects timeout for interactive client connections. |
| 176 | Check Wait Timeout | SHOW VARIABLES LIKE 'wait_timeout'; | Inspects timeout for non-interactive client connections. |
| 177 | Check Max Heap Table Size | SHOW VARIABLES LIKE 'max_heap_table_size'; | Inspects max size for MEMORY engine tables. |
| 178 | Check Tmp Table Size | SHOW VARIABLES LIKE 'tmp_table_size'; | Inspects max size for in-memory internal temp tables. |
| 179 | Check Created Tmp Disk Tables | SHOW GLOBAL STATUS LIKE 'Created_tmp_disk_tables'; | Monitors temp tables spilling to disk. |
| 180 | Check Created Tmp Tables | SHOW GLOBAL STATUS LIKE 'Created_tmp_tables'; | Monitors total internal temp tables created. |
| 181 | Check Select Scan Count | SHOW GLOBAL STATUS LIKE 'Select_scan'; | Monitors full table scan execution count. |
| 182 | Check Select Full Join Count | SHOW GLOBAL STATUS LIKE 'Select_full_join'; | Monitors joins missing index keys. |
| 183 | Check Slow Queries Count | SHOW GLOBAL STATUS LIKE 'Slow_queries'; | Monitors total slow queries executed. |
| 184 | Check Com Select Count | SHOW GLOBAL STATUS LIKE 'Com_select'; | Monitors SELECT statements executed. |
| 185 | Check Com Insert Count | SHOW GLOBAL STATUS LIKE 'Com_insert'; | Monitors INSERT statements executed. |
| 186 | Check Com Update Count | SHOW GLOBAL STATUS LIKE 'Com_update'; | Monitors UPDATE statements executed. |
| 187 | Check Com Delete Count | SHOW GLOBAL STATUS LIKE 'Com_delete'; | Monitors DELETE statements executed. |
| 188 | Check Connections Count | SHOW GLOBAL STATUS LIKE 'Connections'; | Monitors total connection attempts since boot. |
| 189 | Check Aborted Connects | SHOW GLOBAL STATUS LIKE 'Aborted_connects'; | Monitors failed client connection attempts. |
| 190 | Check Aborted Clients | SHOW GLOBAL STATUS LIKE 'Aborted_clients'; | Monitors client connections dropped improperly. |
| 191 | Check Query Ping | SELECT 1; | Simple database ping test returning 1. |
| 192 | Check Current User Account | SELECT CURRENT_USER(); | Returns current execution user and host. |
| 193 | Check Current Database Name | SELECT DATABASE(); | Returns active selected database name. |
| 194 | Check System Timestamp | SELECT NOW(); | Returns current server date and time. |
| 195 | Check System UTC Timestamp | SELECT UTC_TIMESTAMP(); | Returns current UTC date and time. |
| 196 | Check System Connection ID | SELECT CONNECTION_ID(); | Returns current connection thread ID. |
| 197 | Check MySQL Version Details | SELECT VERSION(); | Outputs MySQL server build and patch version. |
| 198 | Check Server Uptime Status | SHOW GLOBAL STATUS LIKE 'Uptime'; | Displays server uptime in seconds. |
| 199 | Check Error Log Location | SHOW VARIABLES LIKE 'log_error'; | Inspects file path of server error log. |
| 200 | Check Host Name Variable | SHOW VARIABLES LIKE 'hostname'; | Outputs host server hostname. |
SQL Server T-SQL OLTP
Technical Architecture & Overview
Microsoft SQL Server (T-SQL) is a relational enterprise database platform featuring advanced memory-optimized tables (In-Memory OLTP / Hekaton), Columnstore indexes, AlwaysOn Availability Groups, transparent data encryption (TDE), and deep integration with Windows/Linux enterprise ecosystems.
Primary Use Cases: Enterprise ERP/CRM transaction engines, high-concurrency financial systems, data warehousing, and mission-critical line-of-business applications.
Core Components: Relational Engine, Storage Engine, Buffer Pool, Transaction Log (WAL), TempDB, Query Store, and AlwaysOn High Availability AGs.
Exhaustive 200-command administrative, diagnostic, and operational matrix for SQL Server T-SQL.
| # | Operation / Action | T-SQL / PowerShell Syntax | Description |
|---|---|---|---|
| 1 | Check Active Sessions | SELECT * FROM sys.dm_exec_sessions WHERE is_user_process = 1; | Inspects client connections. |
| 2 | Check Active Queries | SELECT * FROM sys.dm_exec_requests; | Views running queries. |
| 3 | Kill Process Session | KILL 54; | Terminates blocking SPID. |
| 4 | Backup Database | BACKUP DATABASE EnterpriseDB TO DISK = 'C:\Backup\db.bak' WITH COMPRESSION; | Generates compressed SQL backup. |
| 5 | Restore Database | RESTORE DATABASE EnterpriseDB FROM DISK = 'C:\Backup\db.bak'; | Restores database backup. |
| 6 | Rebuild Indexes | ALTER INDEX ALL ON Users REBUILD WITH (ONLINE = ON); | Rebuilds indexes without downtime. |
| 7 | Update Statistics | UPDATE STATISTICS Users WITH FULLSCAN; | Refreshes query optimizer stats. |
| 8 | Check Database Integrity | DBCC CHECKDB (EnterpriseDB); | Scans for physical corruption. |
| 9 | Shrink Database Log | DBCC SHRINKFILE (EnterpriseDB_Log, 100); | Truncates transaction log size. |
| 10 | Create Login | CREATE LOGIN AppUser WITH PASSWORD = 'SecurePassword123!'; | Provisions server-level login. |
| 11 | Create Database User | CREATE USER AppUser FOR LOGIN AppUser; | Maps login to database user. |
| 12 | Grant Role Permissions | ALTER ROLE db_datareader ADD MEMBER AppUser; | Grants read-only access rights. |
| 13 | Check Index Fragmentation | SELECT * FROM sys.dm_db_index_physical_stats(DB_ID(), NULL, NULL, NULL, 'LIMITED'); | Evaluates index fragmentation levels. |
| 14 | View Blocking Chains | SELECT * FROM sys.dm_os_waiting_tasks WHERE blocking_session_id IS NOT NULL; | Identifies blocking locks. |
| 15 | Get Database Sizes | SELECT name, size * 8 / 1024 AS SizeMB FROM sys.master_files; | Calculates file storage use. |
| 16 | Clear Plan Cache | DBCC FREEPROCCACHE; | Flushes compiled query plans. |
| 17 | Clear Buffer Pool | DBCC DROPCLEANBUFFERS; | Flushes clean buffers from memory. |
| 18 | Enable Extended Events | ALTER EVENT SESSION [SystemDiagnostics] ON SERVER STATE = START; | Activates diagnostic telemetry. |
| 19 | Create Database | CREATE DATABASE EnterpriseDB; | Provisions new database. |
| 20 | Drop Database | DROP DATABASE EnterpriseDB; | Deletes database instance. |
| 21 | Check AlwaysOn Status | SELECT * FROM sys.dm_hadr_availability_replica_states; | Inspects high availability sync. |
| 22 | Failover Availability Group | ALTER AVAILABILITY GROUP EnterpriseAG FAILOVER; | Triggers manual AG failover. |
| 23 | Set Recovery Model | ALTER DATABASE EnterpriseDB SET RECOVERY FULL; | Configures transaction log recovery. |
| 24 | Create Schema | CREATE AUTHORIZATION ON SCHEMA::dbo TO AppUser; | Modifies schema ownership. |
| 25 | Get Execution Stats | SELECT TOP 10 text, execution_count FROM sys.dm_exec_query_stats qs CROSS APPLY sys.dm_exec_sql_text(qs.sql_handle); | Finds most expensive queries. |
| 26 | Configure Max Server Memory | EXEC sp_configure 'max server memory (MB)', 16384; RECONFIGURE; | Limits buffer pool RAM usage. |
| 27 | Check Agent Jobs | EXEC msdb.dbo.sp_help_job; | Lists scheduled SQL Agent jobs. |
| 28 | Run Agent Job | EXEC msdb.dbo.sp_start_job N'NightlyBackup'; | Manually triggers job execution. |
| 29 | View Deadlock Graphs | SELECT xed.value('(event/@name)[1]', 'varchar(150)') FROM sys.fn_xe_file_target_read_file('system_health*.xel', null, null, null); | Inspects historical deadlock logs. |
| 30 | Check Service Status | powershell "Get-Service MSSQLSERVER" | Verifies Windows service state. |
| 31 | Reorganize Index | ALTER INDEX ALL ON Users REORGANIZE; | Defragments index pages in-place. |
| 32 | Set Page Verify Option | ALTER DATABASE EnterpriseDB SET PAGE_VERIFY CHECKSUM; | Enforces page checksum validation. |
| 33 | Set Auto Shrink Off | ALTER DATABASE EnterpriseDB SET AUTO_SHRINK OFF; | Disables auto-shrink to prevent fragmentation. |
| 34 | Set Auto Create Stats | ALTER DATABASE EnterpriseDB SET AUTO_CREATE_STATISTICS ON; | Enables automatic optimizer stats creation. |
| 35 | Set Auto Update Stats | ALTER DATABASE EnterpriseDB SET AUTO_UPDATE_STATISTICS ON; | Enables automatic optimizer stats updates. |
| 36 | Set Auto Update Stats Async | ALTER DATABASE EnterpriseDB SET AUTO_UPDATE_STATISTICS_ASYNC ON; | Asynchronously updates optimizer statistics. |
| 37 | Set Parameter Sniffing Off | ALTER DATABASE SCOPED CONFIGURATION SET PARAMETER_SNIFFING = OFF; | Disables parameter sniffing for query plans. |
| 38 | Set Max Degree of Parallelism | ALTER DATABASE SCOPED CONFIGURATION SET MAXDOP = 4; | Caps query execution parallel DOP. |
| 39 | Set Query Store On | ALTER DATABASE EnterpriseDB SET QUERY_STORE = ON; | Enables Query Store performance recorder. |
| 40 | Clear Query Store | ALTER DATABASE EnterpriseDB SET QUERY_STORE CLEAR; | Purges recorded Query Store telemetry. |
| 41 | Check Query Store Runtime Stats | SELECT * FROM sys.query_store_runtime_stats; | Inspects execution duration and CPU usage. |
| 42 | Check Query Store Plans | SELECT * FROM sys.query_store_plan; | Inspects compiled execution plans in Query Store. |
| 43 | Force Query Plan | EXEC sp_query_store_force_plan @query_id = 10, @plan_id = 5; | Forces Query Store to use specific plan. |
| 44 | Unforce Query Plan | EXEC sp_query_store_unforce_plan @query_id = 10, @plan_id = 5; | Unforces query plan override. |
| 45 | Take Differential Backup | BACKUP DATABASE EnterpriseDB TO DISK = 'C:\Backup\db_diff.bak' WITH DIFFERENTIAL; | Backs up changes since full backup. |
| 46 | Take Log Backup | BACKUP LOG EnterpriseDB TO DISK = 'C:\Backup\log.trn'; | Backs up active transaction log. |
| 47 | Restore Log Backup | RESTORE LOG EnterpriseDB FROM DISK = 'C:\Backup\log.trn' WITH NORECOVERY; | Restores transaction log chain. |
| 48 | Restore Final Log | RESTORE LOG EnterpriseDB FROM DISK = 'C:\Backup\log_final.trn' WITH RECOVERY; | Finalizes database recovery sequence. |
| 49 | Check Backup History | SELECT * FROM msdb.dbo.backupset; | Inspects historical database backup logs. |
| 50 | Check Restore History | SELECT * FROM msdb.dbo.restorehistory; | Inspects historical database restore logs. |
| 51 | Check Suspect Pages | SELECT * FROM msdb.dbo.suspect_pages; | Inspects pages flagged for I/O errors. |
| 52 | Check DBCC Inputbuffer | DBCC INPUTBUFFER(54); | Shows last SQL statement sent by SPID. |
| 53 | Check DBCC OPENTRAN | DBCC OPENTRAN(EnterpriseDB); | Identifies oldest active open transaction. |
| 54 | Check DBCC SQLPERF | DBCC SQLPERF(LOGSPACE); | Monitors transaction log space usage. |
| 55 | Check DBCC USEROPTIONS | DBCC USEROPTIONS; | Inspects active session SET configuration options. |
| 56 | Grant Server Role | ALTER SERVER ROLE sysadmin ADD MEMBER AppUser; | Grants sysadmin server privileges. |
| 57 | Deny Table Select | DENY SELECT ON Users TO AppUser; | Explicitly blocks read access on table. |
| 58 | Revoke Permission | REVOKE SELECT ON Users FROM AppUser; | Removes granted or denied permission. |
| 59 | Create Application Role | CREATE APPLICATION ROLE AppRole WITH PASSWORD = 'RolePass123!'; | Provisions application role. |
| 60 | Create Server Audit | CREATE SERVER AUDIT AppAudit TO FILE (FILEPATH = 'C:\Audit\'); | Provisions server audit specification. |
| 61 | Enable Server Audit | ALTER SERVER AUDIT AppAudit WITH (STATE = ON); | Activates server audit logging. |
| 62 | Create Database Audit Spec | CREATE DATABASE AUDIT SPECIFICATION DbAudit SPECIFICATION FOR SERVER AUDIT AppAudit ADD (SELECT ON Users BY PUBLIC); | Audits queries on table. |
| 63 | Enable Database Audit Spec | ALTER DATABASE AUDIT SPECIFICATION DbAudit WITH (STATE = ON); | Activates database audit spec. |
| 64 | Create Column Encryption Key | CREATE COLUMN ENCRYPTION KEY CEK1 WITH VALUES (COLUMN_MASTER_KEY = CMK1, ALGORITHM = 'RSA_OAEP'); | Provisions Always Encrypted key. |
| 65 | Create Columnstore Index | CREATE CLUSTERED COLUMNSTORE INDEX cci_facts ON FactSales; | Provisions high-speed analytics Columnstore. |
| 66 | Create Nonclustered Columnstore | CREATE NONCLUSTERED COLUMNSTORE INDEX ncci_sales ON FactSales(Amount, DateKey); | Provisions secondary Columnstore index. |
| 67 | Reorganize Columnstore Index | ALTER INDEX cci_facts ON FactSales REORGANIZE WITH (COMPRESS_ALL_ROW_GROUPS = ON); | Compacts Rowgroups in Columnstore. |
| 68 | Create Partition Scheme | CREATE PARTITION SCHEME ps_date AS PARTITION pf_date TO (fg1, fg2, fg3); | Maps partitions to filegroups. |
| 69 | Create Partition Function | CREATE PARTITION FUNCTION pf_date (datetime2) AS RANGE RIGHT FOR VALUES ('2026-01-01', '2027-01-01'); | Provisions partition boundaries. |
| 70 | Split Partition Range | ALTER PARTITION FUNCTION pf_date() SPLIT RANGE ('2026-07-01'); | Splits existing partition range. |
| 71 | Merge Partition Range | ALTER PARTITION FUNCTION pf_date() MERGE RANGE ('2026-07-01'); | Merges adjacent partition ranges. |
| 72 | Switch Partition Table | ALTER TABLE Sales SWITCH PARTITION 1 TO SalesArchive PARTITION 1; | Instantly moves partition data. |
| 73 | Create Filegroup | ALTER DATABASE EnterpriseDB ADD FILEGROUP FG_Data2026; | Provisions secondary filegroup. |
| 74 | Add File to Filegroup | ALTER DATABASE EnterpriseDB ADD FILE (NAME = N'Data2026', FILENAME = N'C:\Data\Data2026.ndf') TO FILEGROUP FG_Data2026; | Adds storage file to filegroup. |
| 75 | Set Default Filegroup | ALTER DATABASE EnterpriseDB MODIFY FILEGROUP FG_Data2026 DEFAULT; | Sets primary target filegroup. |
| 76 | Check TempDB Contention | SELECT * FROM sys.dm_os_waiting_tasks WHERE page_workspace_clone = 1 OR resource_description LIKE '2:%'; | Monitors TempDB allocation bottleneck. |
| 77 | Check TempDB Usage | SELECT * FROM sys.dm_db_file_space_usage; | Monitors TempDB file utilization. |
| 78 | Set Containment Type | ALTER DATABASE EnterpriseDB SET CONTAINMENT = PARTIAL; | Configures contained database model. |
| 79 | Set Change Data Capture On | EXEC sys.sp_cdc_enable_db; | Activates CDC on database level. |
| 80 | Enable CDC on Table | EXEC sys.sp_cdc_enable_table @source_schema = N'dbo', @source_name = N'Users', @role_name = NULL; | Tracks table changes via CDC. |
| 81 | Disable CDC on Table | EXEC sys.sp_cdc_disable_table @source_schema = N'dbo', @source_name = N'Users', @capture_instance = N'all'; | Stops CDC tracking on table. |
| 82 | Check CDC Errors | SELECT * FROM sys.dm_cdc_errors; | Inspects CDC capture and cleanup job errors. |
| 83 | Set Change Tracking On | ALTER DATABASE EnterpriseDB SET CHANGE_TRACKING = ON (CHANGE_RETENTION = 2 DAYS, AUTO_CLEANUP = ON); | Activates Change Tracking. |
| 84 | Enable Change Tracking Table | ALTER TABLE Users ENABLE CHANGE_TRACKING; | Enforces change tracking on table. |
| 85 | Get Change Tracking Changes | SELECT * FROM CHANGETABLE(CHANGES Users, 0) AS CT; | Pulls table mutation history. |
| 86 | Set Snapshot Isolation | ALTER DATABASE EnterpriseDB SET ALLOW_SNAPSHOT_ISOLATION ON; | Enforces row-versioning snapshot isolation. |
| 87 | Set Read Committed Snapshot | ALTER DATABASE EnterpriseDB SET READ_COMMITTED_SNAPSHOT ON; | Eliminates read locks using RCSI. |
| 88 | Check Wait Statistics | SELECT * FROM sys.dm_os_wait_stats ORDER BY wait_time_ms DESC; | Pulls server-wide wait type statistics. |
| 89 | Clear Wait Statistics | DBCC SQLPERF('sys.dm_os_wait_stats', CLEAR); | Resets wait statistics memory counters. |
| 90 | Check Memory Clerks | SELECT type, SUM(pages_kb) FROM sys.dm_os_memory_clerks GROUP BY type ORDER BY SUM(pages_kb) DESC; | Analyzes memory allocation breakdown. |
| 91 | Check Ring Buffer Events | SELECT * FROM sys.dm_os_ring_buffers; | Inspects internal memory and exception events. |
| 92 | Check Latches | SELECT * FROM sys.dm_os_latch_stats ORDER BY wait_time_ms DESC; | Analyzes thread latch contention. |
| 93 | Check Spinlocks | SELECT * FROM sys.dm_os_spinlock_stats ORDER BY spins DESC; | Analyzes CPU spinlock contention. |
| 94 | Check Buffer Descriptors | SELECT count(*)*8/1024 AS MB, DB_NAME(database_id) FROM sys.dm_os_buffer_descriptors GROUP BY database_id; | Inspects RAM cache usage per DB. |
| 95 | Check Missing Index DMV | SELECT * FROM sys.dm_db_missing_index_details; | Finds recommended indexes from optimizer. |
| 96 | Check Unused Index DMV | SELECT * FROM sys.dm_db_index_usage_stats WHERE user_scans = 0 AND user_seeks = 0; | Finds indexes with zero query usage. |
| 97 | Create Extended Event Session | CREATE EVENT SESSION [XE_SlowQueries] ON SERVER ADD EVENT sqlserver.sql_statement_completed(WHERE duration > 1000000); | Provisions XE tracing for slow queries. |
| 98 | Drop Extended Event Session | DROP EVENT SESSION [XE_SlowQueries] ON SERVER; | Removes Extended Event session. |
| 99 | Verify Product Version | SELECT @@VERSION; | Outputs running SQL Server build and patch version. |
| 100 | Set Database Offline | ALTER DATABASE EnterpriseDB SET OFFLINE WITH ROLLBACK IMMEDIATE; | Forces database offline instantly. |
| 101 | Check TempDB Allocation Contention | SELECT * FROM sys.dm_os_waiting_tasks WHERE resource_description LIKE '2:%'; | Identifies PFS/GAM page contention in TempDB. |
| 102 | Add TempDB Data Files | ALTER DATABASE tempdb ADD FILE (NAME = N'tempdev2', FILENAME = N'C:\TempDB\tempdev2.ndf', SIZE = 1024MB); | Adds data file to balance TempDB I/O. |
| 103 | Check Memory Grant Warnings | SELECT * FROM sys.dm_exec_query_memory_grants WHERE grant_time IS NULL; | Identifies queries waiting for memory grants. |
| 104 | Check Resource Governor Pools | SELECT * FROM sys.dm_resource_governor_resource_pools; | Monitors CPU and RAM allocation across pools. |
| 105 | Create Resource Governor Pool | CREATE RESOURCE POOL BatchPool WITH (MAX_CPU_PERCENT = 50, MAX_MEMORY_PERCENT = 30); | Caps batch workload CPU/RAM. |
| 106 | Create Resource Governor Group | CREATE WORKLOAD GROUP BatchGroup USING BatchPool; | Maps workload group to resource pool. |
| 107 | Alter Resource Governor Reconfigure | ALTER RESOURCE GOVERNOR RECONFIGURE; | Applies Resource Governor configuration changes. |
| 108 | Check In-Memory OLTP Tables | SELECT * FROM sys.memory_optimized_tables_internal_attributes; | Inspects Hekaton in-memory tables. |
| 109 | Create Memory Optimized Table | CREATE TABLE dbo.FastCart (id INT NOT NULL PRIMARY KEY NONCLUSTERED HASH WITH (BUCKET_COUNT = 100000)) WITH (MEMORY_OPTIMIZED = ON, DURABILITY = SCHEMA_AND_DATA); | Provisions Hekaton in-memory table. |
| 110 | Check Columnstore Tuple Units | SELECT * FROM sys.dm_db_column_store_row_group_physical_stats; | Inspects Columnstore compressed rowgroups. |
| 111 | Check AlwaysOn Listener Status | SELECT * FROM sys.availability_group_listeners; | Inspects AG network listener IP and port. |
| 112 | Check AlwaysOn Sync Lag | SELECT replica_server_name, log_send_queue_size, log_send_rate FROM sys.dm_hadr_database_replica_states; | Monitors log send queue lag in AG. |
| 113 | Set AlwaysOn Sync Mode | ALTER AVAILABILITY GROUP EnterpriseAG MODIFY REPLICA ON 'NODE2' WITH (AVAILABILITY_MODE = SYNCHRONOUS_COMMIT); | Configures zero-data-loss sync mode. |
| 114 | Check Backup Verification | RESTORE VERIFYONLY FROM DISK = 'C:\Backup\db.bak'; | Validates backup tape/disk file integrity. |
| 115 | Check Page Verify Error | SELECT DB_NAME(database_id), file_id, page_id, error_type FROM sys.dm_db_mirroring_auto_page_repair; | Inspects automatic page repair logs. |
| 116 | Check File Auto Growth Events | SELECT * FROM sys.fn_trace_gettable('C:\Trace\log.trc', default) WHERE EventClass IN (92, 93); | Monitors file auto-expansion events. |
| 117 | Set File Autogrowth In MB | ALTER DATABASE EnterpriseDB MODIFY FILE (NAME = N'EnterpriseDB', FILEGROWTH = 512MB); | Enforces fixed MB autogrowth to prevent fragmentation. |
| 118 | Check Database Encryption TDE | SELECT db_name(database_id), encryption_state FROM sys.dm_database_encryption_keys; | Inspects TDE transparent encryption state. |
| 119 | Enable Database Encryption | ALTER DATABASE EnterpriseDB SET ENCRYPTION ON; | Activates TDE background encryption. |
| 120 | Check Extended Events Sessions | SELECT * FROM sys.dm_xe_sessions; | Lists active running Extended Event sessions. |
| 121 | Stop Extended Events Session | ALTER EVENT SESSION [SystemDiagnostics] ON SERVER STATE = STOP; | Halts Extended Event session. |
| 122 | Check Partition Ranges Info | SELECT * FROM sys.partition_range_values; | Inspects boundary values of partition functions. |
| 123 | Check Table Partition Distribution | SELECT p.partition_number, p.rows FROM sys.partitions p WHERE p.object_id = OBJECT_ID('Sales'); | Inspects row count per partition. |
| 124 | Check Database Compatibility Level | SELECT name, compatibility_level FROM sys.databases WHERE name = 'EnterpriseDB'; | Inspects T-SQL compatibility version. |
| 125 | Set Database Compatibility Level | ALTER DATABASE EnterpriseDB SET COMPATIBILITY_LEVEL = 160; | Upgrades compatibility to SQL Server 2022. |
| 126 | Check Server Collation | SELECT SERVERPROPERTY('Collation'); | Outputs default server collation. |
| 127 | Check Database User Permissions | SELECT * FROM sys.database_permissions WHERE grantee_principal_id = USER_ID('AppUser'); | Lists explicit permissions assigned to user. |
| 128 | Check Server Role Members | SELECT * FROM sys.server_role_members; | Lists accounts assigned to server admin roles. |
| 129 | Check System Uptime SQL | SELECT sqlserver_start_time FROM sys.dm_os_sys_info; | Outputs exact SQL Server boot timestamp. |
| 130 | Verify SQL Version String | SELECT @@VERSION; | Outputs SQL Server edition and CU patch build string. |
| 131 | Check Database Status | SELECT name, state_desc FROM sys.databases; | Inspects database ONLINE/OFFLINE state. |
| 132 | Check Database Recovery State | SELECT name, recovery_model_desc FROM sys.databases; | Inspects recovery model (FULL, SIMPLE, BULK_LOGGED). |
| 133 | Check Database Log Reuse Wait | SELECT name, log_reuse_wait_desc FROM sys.databases; | Identifies reason preventing log truncation. |
| 134 | Check Database File Autogrowth | SELECT name, growth, is_percent_growth FROM sys.master_files; | Inspects autogrowth settings for files. |
| 135 | Check Database File Space Free | SELECT name, size*8/1024 AS SizeMB, FILEPROPERTY(name, 'SpaceUsed')*8/1024 AS UsedMB FROM sys.database_files; | Calculates free space inside data files. |
| 136 | Check Database VLF Count | SELECT name, COUNT(l.database_id) AS VLFCount FROM sys.databases d CROSS APPLY sys.dm_db_log_info(d.database_id) l GROUP BY name; | Monitors Virtual Log File count to prevent degradation. |
| 137 | Check TempDB Allocation Pages | SELECT * FROM sys.dm_db_page_info(2, 1, 1, 'DETAILED'); | Inspects TempDB GAM page header details. |
| 138 | Check Wait Stats Top 10 | SELECT TOP 10 wait_type, waiting_tasks_count, wait_time_ms FROM sys.dm_os_wait_stats WHERE wait_type NOT LIKE '%SLEEP%' ORDER BY wait_time_ms DESC; | Lists top blocking wait types. |
| 139 | Check Memory Grants Pending | SELECT * FROM sys.dm_exec_query_memory_grants WHERE grant_time IS NULL; | Lists queries queued waiting for RAM grant. |
| 140 | Check Active Transactions DMV | SELECT * FROM sys.dm_tran_active_transactions; | Lists all open active transactions. |
| 141 | Check Session Transactions DMV | SELECT * FROM sys.dm_tran_session_transactions; | Maps active transactions to SPIDs. |
| 142 | Check Lock Escalation Mode | SELECT name, lock_escalation_desc FROM sys.tables; | Inspects lock escalation settings (TABLE, AUTO, DISABLE). |
| 143 | Set Lock Escalation Disable | ALTER TABLE Users SET (LOCK_ESCALATION = DISABLE); | Prevents row locks from escalating to table lock. |
| 144 | Set Lock Escalation Auto | ALTER TABLE Users SET (LOCK_ESCALATION = AUTO); | Allows partition-level lock escalation. |
| 145 | Check Index Usage Stats DMV | SELECT OBJECT_NAME(object_id), user_seeks, user_scans, user_lookups, user_updates FROM sys.dm_db_index_usage_stats WHERE database_id = DB_ID(); | Pulls read vs write I/O per index. |
| 146 | Check Operational Index Stats DMV | SELECT OBJECT_NAME(object_id), page_latch_wait_count, page_io_latch_wait_count FROM sys.dm_db_index_operational_stats(DB_ID(), NULL, NULL, NULL); | Monitors latch contention per index page. |
| 147 | Check Physical Index Stats DMV | SELECT OBJECT_NAME(object_id), avg_fragmentation_in_percent, page_count FROM sys.dm_db_index_physical_stats(DB_ID(), NULL, NULL, NULL, 'SAMPLED'); | Evaluates index fragmentation percentage. |
| 148 | Check Index Operational Leaf Inserts | SELECT OBJECT_NAME(object_id), leaf_insert_count FROM sys.dm_db_index_operational_stats(DB_ID(), NULL, NULL, NULL); | Measures leaf page write activity. |
| 149 | Check Missing Index Groups DMV | SELECT * FROM sys.dm_db_missing_index_groups; | Maps missing index details to group IDs. |
| 150 | Check Missing Index Group Stats DMV | SELECT * FROM sys.dm_db_missing_index_group_stats ORDER BY avg_user_impact DESC; | Ranks missing index recommendations by performance impact. |
| 151 | Check Query Execution Stats Top CPU | SELECT TOP 10 total_worker_time/execution_count AS avg_cpu_time, text FROM sys.dm_exec_query_stats CROSS APPLY sys.dm_exec_sql_text(sql_handle) ORDER BY avg_cpu_time DESC; | Finds queries with highest average CPU consumption. |
| 152 | Check Query Execution Stats Top Logical Reads | SELECT TOP 10 total_logical_reads/execution_count AS avg_logical_reads, text FROM sys.dm_exec_query_stats CROSS APPLY sys.dm_exec_sql_text(sql_handle) ORDER BY avg_logical_reads DESC; | Finds queries with highest memory buffer reads. |
| 153 | Check Query Execution Stats Top Physical Reads | SELECT TOP 10 total_physical_reads/execution_count AS avg_physical_reads, text FROM sys.dm_exec_query_stats CROSS APPLY sys.dm_exec_sql_text(sql_handle) ORDER BY avg_physical_reads DESC; | Finds queries with highest physical disk I/O. |
| 154 | Check Cached Execution Plan XML | SELECT TOP 5 query_plan, text FROM sys.dm_exec_cached_plans CROSS APPLY sys.dm_exec_sql_text(plan_handle) CROSS APPLY sys.dm_exec_query_plan(plan_handle); | Pulls raw graphical XML execution plans from memory. |
| 155 | Check Buffer Cache Size per DB | SELECT DB_NAME(database_id), COUNT(*)*8/1024 AS BufferSizeMB FROM sys.dm_os_buffer_descriptors GROUP BY database_id; | Calculates RAM buffer pool usage per database. |
| 156 | Check Memory Clerks Top Allocation | SELECT TOP 10 type, SUM(pages_kb)/1024 AS SizeMB FROM sys.dm_os_memory_clerks GROUP BY type ORDER BY SUM(pages_kb) DESC; | Analyzes memory allocation across internal components. |
| 157 | Check OS Sys Info | SELECT cpu_count, hyperthread_ratio, physical_memory_kb/1024 AS PhysicalMemoryMB FROM sys.dm_os_sys_info; | Inspects CPU cores, threads, and host RAM. |
| 158 | Check OS Ring Buffers Out Of Memory | SELECT * FROM sys.dm_os_ring_buffers WHERE ring_buffer_type = 'RING_BUFFER_RESOURCE_MONITOR'; | Monitors system and process low-memory events. |
| 159 | Check Server Properties | SELECT SERVERPROPERTY('MachineName'), SERVERPROPERTY('InstanceName'), SERVERPROPERTY('Edition'), SERVERPROPERTY('ProductVersion'); | Pulls host, instance, edition, and build version. |
| 160 | Check Current Session Context | SELECT @@SPID AS SessionID, SYSTEM_USER AS SystemUser, DB_NAME() AS ActiveDatabase; | Pulls current session SPID, user, and database name. |
| 161 | Check Server Uptime | SELECT sqlserver_start_time FROM sys.dm_os_sys_info; | Outputs exact SQL Server boot timestamp. |
| 162 | Check SQL Agent Service Status | SELECT status_desc FROM sys.dm_server_services WHERE servicename LIKE 'SQL Server Agent%'; | Verifies if SQL Agent service is running. |
| 163 | Check Database Master Key TDE | SELECT * FROM sys.symmetric_keys WHERE name LIKE '%DatabaseMasterKey%'; | Verifies master encryption key for TDE. |
| 164 | Check AlwaysOn Replica Health | SELECT replica_server_name, operational_state_desc, connected_state_desc, synchronization_health_desc FROM sys.dm_hadr_availability_replica_states; | Inspects AG replica cluster health. |
| 165 | Check AlwaysOn Database State | SELECT database_name, synchronization_state_desc, synchronization_health_desc FROM sys.dm_hadr_database_replica_cluster_states; | Inspects AG database synchronization state. |
| 166 | Check Service Broker Queues | SELECT name, is_enqueue_enabled, is_dequeue_enabled FROM sys.service_queues; | Inspects Service Broker message queues. |
| 167 | Check Service Broker Endpoints | SELECT name, state_desc, port FROM sys.endpoints WHERE type = 3; | Inspects Service Broker network endpoint port. |
| 168 | Check Database Mirroring Endpoints | SELECT name, state_desc, port FROM sys.endpoints WHERE type = 4; | Inspects Database Mirroring network endpoint port. |
| 169 | Check Database Mirroring Status | SELECT db_name(database_id), mirroring_state_desc, mirroring_role_desc FROM sys.database_mirroring WHERE mirroring_guid IS NOT NULL; | Inspects legacy database mirroring status. |
| 170 | Check Change Tracking Table Status | SELECT OBJECT_NAME(object_id), is_track_columns_updated_on FROM sys.change_tracking_tables; | Inspects Change Tracking enabled tables. |
| 171 | Check CDC Capture Jobs | SELECT * FROM msdb.dbo.cdc_jobs; | Lists active CDC capture and cleanup jobs. |
| 172 | Check Extended Events Buffer Target | SELECT * FROM sys.dm_xe_session_targets; | Inspects event ring buffer targets for XE. |
| 173 | Check Extended Events Packages | SELECT name, description FROM sys.xe_packages; | Lists installed Extended Events packages. |
| 174 | Check Extended Events Event Names | SELECT name, description FROM sys.xe_objects WHERE object_type = 'event' AND name LIKE 'sql%'; | Lists available SQL Server Extended Events. |
| 175 | Check User Defined Functions List | SELECT name, type_desc FROM sys.objects WHERE type IN ('FN', 'IF', 'TF'); | Lists user defined functions in database. |
| 176 | Check Stored Procedures List | SELECT name, create_date, modify_date FROM sys.procedures; | Lists stored procedures in database. |
| 177 | Check Views List | SELECT name, create_date FROM sys.views; | Lists views in database. |
| 178 | Check Triggers List | SELECT name, OBJECT_NAME(parent_id) AS TableName, is_disabled FROM sys.triggers; | Lists triggers in database. |
| 179 | Check Fulltext Catalogs | SELECT name, is_default FROM sys.fulltext_catalogs; | Lists full-text search catalogs. |
| 180 | Check Fulltext Indexes | SELECT OBJECT_NAME(object_id), is_enabled FROM sys.fulltext_indexes; | Lists full-text search indexes. |
| 181 | Check Database Filestream Option | SELECT name, non_transacted_access_desc FROM sys.databases WHERE name = 'EnterpriseDB'; | Inspects FILESTREAM feature settings. |
| 182 | Check Filestream Filegroups | SELECT name, type_desc FROM sys.filegroups WHERE type = 'FD'; | Lists FILESTREAM storage filegroups. |
| 183 | Check Columnstore Rowgroups Compression | SELECT OBJECT_NAME(object_id), row_group_id, state_desc, total_rows FROM sys.dm_db_column_store_row_group_physical_stats; | Inspects Columnstore rowgroup compression states. |
| 184 | Check In-Memory Container Memory | SELECT memory_consumer_type_desc, alloc_size_mb FROM sys.dm_db_xtp_memory_consumers; | Analyzes memory allocation for Hekaton in-memory tables. |
| 185 | Check In-Memory Transactions | SELECT * FROM sys.dm_db_xtp_transactions; | Monitors active transactions on in-memory tables. |
| 186 | Check Database Read Only Setting | SELECT name, is_read_only FROM sys.databases WHERE name = 'EnterpriseDB'; | Inspects read-only setting. |
| 187 | Set Database Read Only | ALTER DATABASE EnterpriseDB SET READ_ONLY WITH ROLLBACK IMMEDIATE; | Forces database into read-only mode. |
| 188 | Set Database Read Write | ALTER DATABASE EnterpriseDB SET READ_WRITE; | Restores database to read-write mode. |
| 189 | Check Database Single User Setting | SELECT name, user_access_desc FROM sys.databases WHERE name = 'EnterpriseDB'; | Inspects user access mode (MULTI_USER, SINGLE_USER, RESTRICTED_USER). |
| 190 | Set Database Single User | ALTER DATABASE EnterpriseDB SET SINGLE_USER WITH ROLLBACK IMMEDIATE; | Forces database into single user mode for maintenance. |
| 191 | Set Database Multi User | ALTER DATABASE EnterpriseDB SET MULTI_USER; | Restores database to multi-user mode. |
| 192 | Check Database Parameterization Setting | SELECT name, is_parameterization_forced FROM sys.databases WHERE name = 'EnterpriseDB'; | Inspects forced parameterization setting. |
| 193 | Set Forced Parameterization | ALTER DATABASE EnterpriseDB SET PARAMETERIZATION FORCED; | Enforces automatic query parameterization. |
| 194 | Set Simple Parameterization | ALTER DATABASE EnterpriseDB SET PARAMETERIZATION SIMPLE; | Restores default simple query parameterization. |
| 195 | Check Database ANSI NULLS Setting | SELECT name, is_ansi_nulls_on FROM sys.databases WHERE name = 'EnterpriseDB'; | Inspects ANSI NULLS default setting. |
| 196 | Check Database QUOTED IDENTIFIER Setting | SELECT name, is_quoted_identifier_on FROM sys.databases WHERE name = 'EnterpriseDB'; | Inspects QUOTED_IDENTIFIER default setting. |
| 197 | Check Database Cursor Default Setting | SELECT name, is_cursor_close_on_commit_on FROM sys.databases WHERE name = 'EnterpriseDB'; | Inspects cursor close on commit setting. |
| 198 | Check Database Page Verify Method | SELECT name, page_verify_option_desc FROM sys.databases WHERE name = 'EnterpriseDB'; | Inspects page verify option (CHECKSUM, TORN_PAGE_DETECTION, NONE). |
| 199 | Verify Product Version | SELECT @@VERSION; | Outputs full SQL Server version, architecture, and build string. |
| 200 | Check Ping Query | SELECT 1; | Simple connection ping query. |
Oracle Database OLTP
Technical Architecture & Overview
Oracle Database is a enterprise multi-model RDBMS featuring high-performance Multitenant architecture (Container DB / Pluggable DB), Real Application Clusters (RAC) scale-out shared-everything clustering, Automatic Storage Management (ASM), Data Guard replication, and RMAN recovery manager.
Primary Use Cases: Mission-critical core banking, ERP, global supply chain transactional platforms, and high-availability enterprise applications.
Core Components: System Global Area (SGA), Program Global Area (PGA), Database Writer (DBWn), Log Writer (LGWR), Process Monitor (PMON), System Monitor (SMON), and Multitenant PDBs.
Exhaustive 200-command administrative, diagnostic, and operational matrix for Oracle Database.
| # | Operation / Action | SQL*Plus / RMAN Syntax | Description |
|---|---|---|---|
| 1 | Startup Instance | STARTUP NOMOUNT; ALTER DATABASE MOUNT; ALTER DATABASE OPEN; | Boots Oracle database instance. |
| 2 | Shutdown Instance | SHUTDOWN IMMEDIATE; | Halts database instance safely. |
| 3 | Connect via SQL*Plus | sqlplus sys/password@ORCL as sysdba | Opens administrative SQL session. |
| 4 | RMAN Backup Database | RMAN> BACKUP DATABASE PLUS ARCHIVELOG; | Executes RMAN enterprise backup. |
| 5 | RMAN Restore Database | RMAN> RESTORE DATABASE; RECOVER DATABASE; | Restores and recovers files. |
| 6 | Check Tablespace Usage | SELECT tablespace_name, sum(bytes)/1024/1024 FROM dba_free_space GROUP BY tablespace_name; | Evaluates storage capacity. |
| 7 | Add Datafile | ALTER TABLESPACE users ADD DATAFILE '/u01/app/oracle/oradata/users02.dbf' SIZE 2G; | Expands tablespace storage. |
| 8 | Create User | CREATE USER app_user IDENTIFIED BY SecurePass123; | Provisions database user. |
| 9 | Grant DBA Roles | GRANT CONNECT, RESOURCE, DBA TO app_user; | Assigns administrative privileges. |
| 10 | View Active Sessions | SELECT sid, serial#, username, status FROM v$session; | Inspects active database users. |
| 11 | Kill Session | ALTER SYSTEM KILL SESSION '145,2341'; | Terminates hung user session. |
| 12 | Gather Table Statistics | EXEC DBMS_STATS.GATHER_TABLE_STATS(ownname => 'HR', tabname => 'EMPLOYEES'); | Updates optimizer statistics. |
| 13 | Explain Execution Plan | EXPLAIN PLAN FOR SELECT * FROM employees; | Generates query execution plan. |
| 14 | Check Alert Log | SELECT message_text FROM v$diag_alert_ext ORDER BY recorded_time DESC; | Inspects system diagnostic alerts. |
| 15 | Flush Shared Pool | ALTER SYSTEM FLUSH SHARED_POOL; | Clears compiled cursor memory. |
| 16 | Resize SGA Buffer | ALTER SYSTEM SET sga_target = 8G SCOPE=BOTH; | Adjusts memory allocation pool. |
| 17 | Create Index | CREATE INDEX idx_emp_email ON employees(email) TABLESPACE users; | Provisions table index. |
| 18 | Drop Index | DROP INDEX idx_emp_email; | Removes table index. |
| 19 | Check Redo Log Status | SELECT group#, status, bytes FROM v$log; | Inspects transactional redo logs. |
| 20 | Switch Redo Log | ALTER SYSTEM SWITCH LOGFILE; | Forces active log file rotation. |
| 21 | Create Table Partition | CREATE TABLE sales (sale_date DATE) PARTITION BY RANGE (sale_date) (...); | Provisions partitioned table. |
| 22 | Check Data Guard Sync | SELECT dest_id, status, gap_status FROM v$archive_dest_status; | Verifies standby replication sync. |
| 23 | Create Profile Password | CREATE PROFILE secure_user LIMIT PASSWORD_LIFE_TIME 90; | Enforces password governance policy. |
| 24 | View Lock Waiters | SELECT * FROM v$lock WHERE block > 0; | Identifies lock contention sources. |
| 25 | Enable Tracing | EXEC DBMS_SESSION.SET_SQL_TRACE_IN_SESSION(sid=>145, serial#=>2341, sql_trace=>TRUE); | Activates detailed event tracing. |
| 26 | Purge Recycle Bin | PURGE DBA_RECYCLEBIN; | Empties dropped table storage. |
| 27 | Verify Patch Level | SELECT * FROM dba_registry_sqlpatch; | Inspects database patch history. |
| 28 | Create Database Link | CREATE DATABASE LINK remote_db CONNECT TO user IDENTIFIED BY pass USING 'ORCL_REMOTE'; | Provisions federated database link. |
| 29 | Check Invalid Objects | SELECT owner, object_name FROM dba_objects WHERE status = 'INVALID'; | Identifies broken compiled routines. |
| 30 | Check Service Status | lsnrctl status | Verifies Oracle TNS listener state. |
| 31 | Recompile Invalid Objects | EXEC DBMS_UTILITY.COMPILE_SCHEMA('HR'); | Recompiles all invalid PL/SQL objects in schema. |
| 32 | Set PGA Target | ALTER SYSTEM SET pga_aggregate_target = 4G SCOPE=BOTH; | Adjusts Program Global Area memory target. |
| 33 | Check Memory Advisory | SELECT * FROM v$sga_target_advice; | Provides sizing recommendations for SGA. |
| 34 | Check PGA Advisory | SELECT * FROM v$pga_target_advice; | Provides sizing recommendations for PGA. |
| 35 | Create Temporary Tablespace | CREATE TEMPORARY TABLESPACE temp02 TEMPFILE '/u01/app/oracle/oradata/temp02.dbf' SIZE 1G; | Adds secondary temp tablespace. |
| 36 | Resize Datafile | ALTER DATABASE DATAFILE '/u01/app/oracle/oradata/users01.dbf' RESIZE 10G; | Resizes datafile volume size. |
| 37 | Enable Autoextend Datafile | ALTER DATABASE DATAFILE '/u01/app/oracle/oradata/users01.dbf' AUTOEXTEND ON NEXT 100M MAXSIZE 32G; | Sets auto-growth settings. |
| 38 | Drop Tablespace | DROP TABLESPACE users INCLUDING CONTENTS AND DATAFILES; | Deletes tablespace and files from disk. |
| 39 | Create Undo Tablespace | CREATE UNDO TABLESPACE undotbs2 DATAFILE '/u01/app/oracle/oradata/undotbs02.dbf' SIZE 2G; | Provisions new Undo tablespace. |
| 40 | Switch Undo Tablespace | ALTER SYSTEM SET undo_tablespace = undotbs2 SCOPE=BOTH; | Activates new Undo tablespace. |
| 41 | Check Undo Retention | SHOW PARAMETER undo_retention; | Inspects undo retention duration setting. |
| 42 | Set Undo Retention | ALTER SYSTEM SET undo_retention = 3600 SCOPE=BOTH; | Enforces 1-hour undo retention for flashback. |
| 43 | Check ASM Disk Group | SELECT name, state, total_mb, free_mb FROM v$asm_diskgroup; | Inspects ASM storage pool capacity. |
| 44 | Add ASM Disk | ALTER DISKGROUP data ADD DISK '/dev/oracleasm/disks/DISK05'; | Expands ASM disk group storage. |
| 45 | Drop ASM Disk | ALTER DISKGROUP data DROP DISK DISK05; | Removes disk from ASM storage group. |
| 46 | Rebalance ASM Diskgroup | ALTER DISKGROUP data REBALANCE POWER 8; | Triggers high-priority ASM rebalance. |
| 47 | RMAN Crosscheck Backup | RMAN> CROSSCHECK BACKUP; | Validates backup file presence on disk/tape. |
| 48 | RMAN Delete Obsolete | RMAN> DELETE OBSOLETE; | Purges expired backups per retention policy. |
| 49 | RMAN Validate Database | RMAN> VALIDATE DATABASE; | Checks datafiles for physical block corruption. |
| 50 | Check Block Corruption DMV | SELECT * FROM v$database_block_corruption; | Lists corrupted data blocks found by RMAN. |
| 51 | Recover Corrupted Block | RMAN> RECOVER DATAFILE 4 BLOCK 128; | Executes online block media recovery. |
| 52 | Create Pluggable DB (PDB) | CREATE PLUGGABLE DATABASE pdb2 ADMIN USER pdb_admin IDENTIFIED BY pass FILE_NAME_CONVERT=('/pdbseed/','/pdb2/'); | Provisions new Multitenant PDB. |
| 53 | Plug PDB into CDB | CREATE PLUGGABLE DATABASE pdb3 USING '/u01/app/oracle/oradata/pdb3.xml' NOCOPY; | Plugs PDB into Container DB. |
| 54 | Unplug PDB from CDB | ALTER PLUGGABLE DATABASE pdb2 UNPLUG INTO '/u01/app/oracle/oradata/pdb2.xml'; | Unplugs PDB into XML metadata file. |
| 55 | Open PDB | ALTER PLUGGABLE DATABASE pdb2 OPEN; | Boots PDB into read-write state. |
| 56 | Close PDB | ALTER PLUGGABLE DATABASE pdb2 CLOSE IMMEDIATE; | Shuts down pluggable database. |
| 57 | Save PDB State | ALTER PLUGGABLE DATABASE ALL SAVE STATE; | Preserves open state across CDB restarts. |
| 58 | Drop PDB | DROP PLUGGABLE DATABASE pdb2 INCLUDING DATAFILES; | Deletes multitenant PDB. |
| 59 | Check Container DB List | SELECT name, open_mode FROM v$pdbs; | Lists all PDBs in CDB. |
| 60 | Switch Container Session | ALTER SESSION SET CONTAINER = pdb1; | Changes current session focus to PDB. |
| 61 | Create Common User | CREATE USER c##app_admin IDENTIFIED BY SecurePass123 CONTAINER=ALL; | Provisions CDB-wide common account. |
| 62 | Grant Common Privilege | GRANT CREATE SESSION TO c##app_admin CONTAINER=ALL; | Grants privilege across all PDBs. |
| 63 | Check AWR Snapshot Config | SELECT snap_interval, retention FROM dba_hist_wr_control; | Inspects AWR repository collection schedule. |
| 64 | Modify AWR Snapshot Interval | EXEC DBMS_WORKLOAD_REPOSITORY.MODIFY_SNAPSHOT_SETTINGS(retention=>40320, interval=>30); | Sets 28-day retention and 30m snaps. |
| 65 | Create AWR Snapshot | EXEC DBMS_WORKLOAD_REPOSITORY.CREATE_SNAPSHOT(); | Triggers manual AWR snapshot. |
| 66 | Generate AWR Report | SELECT * FROM TABLE(DBMS_WORKLOAD_REPOSITORY.AWR_REPORT_HTML(1, 1, 101, 102)); | Generates HTML performance report. |
| 67 | Generate ASH Report | SELECT * FROM TABLE(DBMS_WORKLOAD_REPOSITORY.ASH_REPORT_HTML(1, 1, SYSDATE-1/24, SYSDATE)); | Generates Active Session History report. |
| 68 | Create SQL Tuning Set | EXEC DBMS_SQLTUNE.CREATE_SQLSET('my_sts'); | Provisions container for SQL tuning. |
| 69 | Run SQL Tuning Advisor | DECLARE l_task VARCHAR2(30); BEGIN l_task := DBMS_SQLTUNE.CREATE_TUNING_TASK(sql_id=>'43abc123', task_name=>'tune_q1'); DBMS_SQLTUNE.EXECUTE_TUNING_TASK('tune_q1'); END; | Runs AI query tuning analysis. |
| 70 | Get Tuning Report | SELECT DBMS_SQLTUNE.REPORT_TUNING_TASK('tune_q1') FROM DUAL; | Fetches recommendations and SQL profiles. |
| 71 | Accept SQL Profile | EXEC DBMS_SQLTUNE.ACCEPT_SQL_PROFILE(task_name=>'tune_q1', name=>'prof_q1'); | Applies optimizer plan profile. |
| 72 | Check Active SQL Execution | SELECT sql_id, elapsed_time/1e6, cpu_time/1e6 FROM v$sql WHERE executions > 0; | Monitors CPU and elapsed time. |
| 73 | Gather Schema Statistics | EXEC DBMS_STATS.GATHER_SCHEMA_STATS(ownname=>'HR', options=>'GATHER AUTO'); | Gathers stats for outdated objects. |
| 74 | Lock Table Statistics | EXEC DBMS_STATS.LOCK_TABLE_STATS(ownname=>'HR', tabname=>'EMPLOYEES'); | Prevents automatic stats override. |
| 75 | Unlock Table Statistics | EXEC DBMS_STATS.UNLOCK_TABLE_STATS(ownname=>'HR', tabname=>'EMPLOYEES'); | Allows automatic stats updates. |
| 76 | Flashback Table | FLASHBACK TABLE employees TO TIMESTAMP (SYSTIMESTAMP - INTERVAL '15' MINUTE); | Reverts table state 15 minutes back. |
| 77 | Flashback Database | FLASHBACK DATABASE TO RESTORE POINT before_upgrade; | Reverts whole database to restore point. |
| 78 | Create Restore Point | CREATE RESTORE POINT before_upgrade GUARANTEE FLASHBACK DATABASE; | Provisions guaranteed restore point. |
| 79 | Drop Restore Point | DROP RESTORE POINT before_upgrade; | Deletes restore point. |
| 80 | Check Flashback Logs | SELECT * FROM v$flashback_database_log; | Inspects flashback log space utilization. |
| 81 | Enable Archive Log Mode | ALTER DATABASE ARCHIVELOG; | Enables continuous WAL archiving. |
| 82 | Disable Archive Log Mode | ALTER DATABASE NOARCHIVELOG; | Disables continuous WAL archiving. |
| 83 | Check Archive Destinations | SELECT destination, status FROM v$archive_dest; | Inspects archive log destinations. |
| 84 | Check Lock Waits DMV | SELECT c.owner, c.object_name, c.object_type, b.sid, b.serial# FROM v$locked_object a, v$session b, dba_objects c WHERE a.session_id = b.sid AND a.object_id = c.object_id; | Finds sessions holding locks on objects. |
| 85 | Check Latches DMV | SELECT name, gets, misses, sleeps FROM v$latch ORDER BY sleeps DESC; | Inspects latch contention. |
| 86 | Check Library Cache Pin | SELECT * FROM v$session_wait WHERE event LIKE 'library cache%'; | Identifies PL/SQL package lock waits. |
| 87 | Enable Audit Vault | AUDIT ALL BY app_user BY ACCESS; | Enables fine-grained audit on account. |
| 88 | Disable Audit | NOAUDIT ALL BY app_user; | Stops audit tracking on account. |
| 89 | View Audit Trail | SELECT username, action_name, timestamp FROM dba_audit_trail; | Inspects historical audit log entries. |
| 90 | Check Unified Audit Trail | SELECT event_timestamp, dbusername, action_name FROM unified_audit_trail; | Inspects 12c+ unified audit log. |
| 91 | Set Resource Manager Plan | ALTER SYSTEM SET resource_manager_plan = 'DEFAULT_PLAN' SCOPE=BOTH; | Activates CPU resource governor. |
| 92 | Create Resource Consumer Group | EXEC DBMS_RESOURCE_MANAGER.CREATE_CONSUMER_GROUP(consumer_group=>'batch_grp', comment=>'Batch tasks'); | Provisions CPU consumer group. |
| 93 | Grant Consumer Group | EXEC DBMS_RESOURCE_MANAGER_PRIVS.GRANT_SWITCH_CONSUMER_GROUP('app_user', 'batch_grp', FALSE); | Assigns user to consumer group. |
| 94 | Switch Consumer Group | EXEC DBMS_SESSION.SWITCH_CURRENT_CONSUMER_GROUP('batch_grp', l_old_group, FALSE); | Changes session CPU priority. |
| 95 | Export Schema via Data Pump | expdp hr/pass DIRECTORY=dp_dir DUMPFILE=hr.dmp SCHEMAS=HR; | Exports schema binary via Data Pump. |
| 96 | Import Schema via Data Pump | impdp hr/pass DIRECTORY=dp_dir DUMPFILE=hr.dmp SCHEMAS=HR; | Imports schema binary via Data Pump. |
| 97 | Kill Data Pump Job | impdp hr/pass ATTACH=SYS_IMPORT_SCHEMA_01 -> KILL_JOB | Stops running Data Pump operation. |
| 98 | Verify Database Version | SELECT * FROM v$version; | Outputs Oracle DB release and patch level. |
| 99 | Check Oracle License Usage | SELECT * FROM v$license; | Inspects active session count vs high-water mark. |
| 100 | Check Flash Recovery Area | SELECT * FROM v$recovery_file_dest; | Inspects FRA disk space and usage percentage. |
| 101 | Check RAC Cluster Interconnect | SELECT * FROM v$cluster_interconnects; | Inspects private network interfaces for RAC nodes. |
| 102 | Check RAC Node Status | SELECT inst_id, instance_name, host_name, status FROM gv$instance; | Inspects status of all RAC cluster instances. |
| 103 | Check RAC Lock Ping Latency | SELECT * FROM v$gc_element WHERE flags > 0; | Monitors Global Cache lock element transfers. |
| 104 | Check ASM Disk Rebalance Status | SELECT * FROM v$asm_operation; | Monitors background ASM disk rebalance progress. |
| 105 | Check Flashback Database Status | SELECT flashback_on FROM v$database; | Verifies if Flashback Database logging is enabled. |
| 106 | Check Flashback Area Usage | SELECT name, space_limit/1024/1024/1024 AS limit_gb, space_used/1024/1024/1024 AS used_gb FROM v$recovery_file_dest; | Monitors FRA storage. |
| 107 | Check Data Guard Lag | SELECT name, value FROM v$dataguard_stats WHERE name LIKE '%lag%'; | Measures transport and apply lag on standby DB. |
| 108 | Set Data Guard Protection Mode | ALTER DATABASE SET STANDBY DATABASE TO MAXIMIZE PROTECTION; | Enforces zero-data-loss synchronous Data Guard. |
| 109 | Check Redo Log Thread Group | SELECT thread#, group#, bytes, status FROM v$log; | Inspects redo log threads across RAC instances. |
| 110 | Add Redo Log File Group | ALTER DATABASE ADD LOGFILE GROUP 4 ('/u01/app/oracle/oradata/redo04.log') SIZE 1G; | Adds 1GB redo log file group. |
| 111 | Drop Redo Log File Group | ALTER DATABASE DROP LOGFILE GROUP 4; | Removes empty redo log group. |
| 112 | Check Table Partition Bound | SELECT partition_name, high_value FROM dba_tab_partitions WHERE table_name = 'SALES'; | Inspects boundary values of table partitions. |
| 113 | Truncate Table Partition | ALTER TABLE sales TRUNCATE PARTITION p2026_q1; | Clears partition records instantly. |
| 114 | Merge Table Partitions | ALTER TABLE sales MERGE PARTITIONS p2026_q1, p2026_q2 INTO PARTITION p2026_h1; | Merges adjacent partitions. |
| 115 | Split Table Partition | ALTER TABLE sales SPLIT PARTITION p2026_h1 AT (TO_DATE('2026-04-01','YYYY-MM-DD')) INTO (PARTITION p2026_q1, PARTITION p2026_q2); | Splits partition. |
| 116 | Check Index Fragmentation Oracle | SELECT index_name, blevel, leaf_blocks, distinct_keys FROM dba_indexes WHERE table_name = 'EMPLOYEES'; | Evaluates B-Tree index depth and blocks. |
| 117 | Coalesce Index | ALTER INDEX idx_emp_email COALESCE; | Defragments index leaf blocks in-place. |
| 118 | Rebuild Index Online | ALTER INDEX idx_emp_email REBUILD ONLINE; | Rebuilds index without locking concurrent DML writes. |
| 119 | Check Table Degree of Parallelism | SELECT table_name, degree FROM dba_tables WHERE table_name = 'EMPLOYEES'; | Inspects table parallel execution degree. |
| 120 | Set Table Parallel Execution | ALTER TABLE employees PARALLEL 8; | Enforces 8 parallel execution threads for queries. |
| 121 | Check SQL Execution Cursor Cache | SELECT sql_text, executions, disk_reads, buffer_gets FROM v$sqlarea WHERE executions > 100 ORDER BY disk_reads DESC; | Finds queries with high physical I/O. |
| 122 | Check Active Session History (ASH) | SELECT sample_time, session_id, sql_id, event FROM v$active_session_history WHERE sample_time > SYSDATE-1/24; | Analyzes wait events in last hour. |
| 123 | Check System Wait Events | SELECT event, total_waits, time_waited FROM v$system_event ORDER BY time_waited DESC; | Pulls top system-wide wait events. |
| 124 | Check Enqueue Lock Waits | SELECT * FROM v$enqueue_stat WHERE failed > 0; | Monitors internal lock enqueue failures. |
| 125 | Check Library Cache Memory | SELECT * FROM v$librarycache; | Monitors cursor parsing and execution hit ratios. |
| 126 | Check Temp Tablespace Space Usage | SELECT tablespace_name, allocated_space, used_space FROM v$temp_space_header; | Inspects temp tablespace page allocations. |
| 127 | Check Active Rollback Undo Segments | SELECT segment_name, status, bytes FROM dba_undo_extents; | Inspects Undo segment allocations. |
| 128 | Check Oracle Database Name | SELECT name, db_unique_name, open_mode FROM v$database; | Outputs database name and open state. |
| 129 | Check Oracle Instance Name | SELECT instance_name, host_name, version FROM v$instance; | Outputs instance name and host info. |
| 130 | Verify Listener Status CLI | lsnrctl status | Verifies TNS network listener process status. |
| 131 | Check Oracle Database Role | SELECT database_role FROM v$database; | Inspects PRIMARY vs STANDBY role. |
| 132 | Check Oracle Protection Mode | SELECT protection_mode, protection_level FROM v$database; | Inspects Data Guard protection level. |
| 133 | Check Oracle Log Mode | SELECT log_mode FROM v$database; | Inspects ARCHIVELOG vs NOARCHIVELOG mode. |
| 134 | Check Oracle Switchover Status | SELECT switchover_status FROM v$database; | Inspects Data Guard switchover readiness. |
| 135 | Check Oracle SGA Dynamic Components | SELECT component, current_size/1024/1024 AS size_mb FROM v$sga_dynamic_components; | Monitors SGA component sizing. |
| 136 | Check Oracle Buffer Cache Hit Ratio | SELECT (1 - (phy.value / (cur.value + con.value))) * 100 AS Hit_Ratio FROM v$sysstat phy, v$sysstat cur, v$sysstat con WHERE phy.name = 'physical reads' AND cur.name = 'db block gets' AND con.name = 'consistent gets'; | Calculates buffer cache hit ratio. |
| 137 | Check Oracle Shared Pool Free Memory | SELECT name, bytes/1024/1024 AS free_mb FROM v$sgastat WHERE name = 'free memory'; | Inspects unallocated shared pool memory. |
| 138 | Check Oracle Library Cache Hit Ratio | SELECT sum(pins)/(sum(pins)+sum(reloads))*100 AS Hit_Ratio FROM v$librarycache; | Calculates library cache cursor execution hit ratio. |
| 139 | Check Oracle Dictionary Cache Hit Ratio | SELECT (1 - (sum(getmisses)/sum(gets)))*100 AS Hit_Ratio FROM v$rowcache; | Calculates data dictionary cache hit ratio. |
| 140 | Check Oracle Undo Retention Guarantee | SELECT tablespace_name, retention FROM dba_tablespaces WHERE contents = 'UNDO'; | Inspects UNDO retention guarantee setting. |
| 141 | Check Oracle Undo Space Usage | SELECT sum(bytes)/1024/1024 AS total_undo_mb FROM dba_data_files WHERE tablespace_name LIKE 'UNDO%'; | Calculates allocated Undo tablespace capacity. |
| 142 | Check Oracle Temp Space Usage | SELECT tablespace_name, sum(bytes_cached)/1024/1024 AS used_temp_mb FROM v$temp_extent_pool GROUP BY tablespace_name; | Calculates temp space usage. |
| 143 | Check Oracle ASM Disks State | SELECT mount_status, header_status, mode_status, path FROM v$asm_disk; | Inspects ASM disk headers and mount state. |
| 144 | Check Oracle ASM Diskgroup Balance | SELECT group_number, name, state, type, total_mb, free_mb FROM v$asm_diskgroup; | Inspects ASM diskgroup total vs free capacity. |
| 145 | Check Oracle RMAN Backup Status | SELECT operation, status, start_time, end_time FROM v$rman_status WHERE start_time > SYSDATE-7 ORDER BY start_time DESC; | Inspects RMAN job statuses for last 7 days. |
| 146 | Check Oracle RMAN Backup Progress | SELECT sid, serial#, opname, sofar, totalwork, round(sofar/totalwork*100,2) AS pct FROM v$session_longops WHERE opname LIKE 'RMAN%' AND totalwork > 0; | Monitors active RMAN backup progress. |
| 147 | Check Oracle Datafile Header Status | SELECT file#, name, status, error FROM v$datafile_header; | Inspects datafile header consistency. |
| 148 | Check Oracle Control Files List | SELECT name FROM v$controlfile; | Lists active control file paths. |
| 149 | Check Oracle Redo Log Member Files | SELECT group#, member, status FROM v$logfile; | Lists redo log member paths and mirror status. |
| 150 | Check Oracle Archived Logs List | SELECT thread#, sequence#, first_change#, next_change#, completion_time FROM v$archived_log WHERE completion_time > SYSDATE-1 ORDER BY sequence# DESC; | Lists archived log files generated in last 24h. |
| 151 | Check Oracle Pluggable DB Open Mode | SELECT name, open_mode, restricted FROM v$pdbs; | Lists PDBs and open status. |
| 152 | Check Oracle PDB Save State | SELECT instance_name, pdb_name, state FROM cdb_pdb_saved_states; | Inspects PDB preserved startup state. |
| 153 | Check Oracle PDB Resource Manager | SELECT plan, status FROM dba_cdb_rsrc_plans; | Inspects multitenant resource manager plan. |
| 154 | Check Oracle Tablespace Encryption | SELECT tablespace_name, encrypted FROM dba_tablespaces; | Inspects TDE encrypted tablespaces. |
| 155 | Check Oracle Wallet Status | SELECT status, wallet_type FROM v$encryption_wallet; | Inspects TDE master key wallet status. |
| 156 | Check Oracle Tablespace Autoextend | SELECT tablespace_name, file_name, autoextensible, maxbytes/1024/1024 AS max_mb FROM dba_data_files; | Inspects auto-growth limits. |
| 157 | Check Oracle Segment Size Top 10 | SELECT * FROM (SELECT owner, segment_name, segment_type, bytes/1024/1024 AS size_mb FROM dba_segments ORDER BY bytes DESC) WHERE ROWNUM <= 10; | Finds 10 largest storage segments in database. |
| 158 | Check Oracle Table Row Count Stats | SELECT table_name, num_rows, blocks, last_analyzed FROM dba_tables WHERE owner = 'HR'; | Inspects table optimizer row count stats. |
| 159 | Check Oracle Index Clustering Factor | SELECT index_name, clustering_factor, leaf_blocks FROM dba_indexes WHERE owner = 'HR'; | Evaluates index data layout alignment with table rows. |
| 160 | Check Oracle Stored Code Errors | SELECT name, type, line, text FROM dba_errors WHERE owner = 'HR'; | Pulls PL/SQL compilation error messages. |
| 161 | Check Oracle System Privilege Grants | SELECT grantee, privilege FROM dba_sys_privs WHERE grantee = 'APP_USER'; | Lists system privileges assigned to user. |
| 162 | Check Oracle Role Grants | SELECT grantee, granted_role FROM dba_role_privs WHERE grantee = 'APP_USER'; | Lists roles assigned to user. |
| 163 | Check Oracle Object Privilege Grants | SELECT grantee, table_name, privilege FROM dba_tab_privs WHERE grantee = 'APP_USER'; | Lists object privileges assigned to user. |
| 164 | Check Oracle Password Profile Limits | SELECT profile, resource_name, limit FROM dba_profiles WHERE resource_type = 'PASSWORD'; | Inspects password policy rules. |
| 165 | Check Oracle User Profile Assignment | SELECT username, profile, account_status FROM dba_users WHERE username = 'APP_USER'; | Inspects assigned profile for account. |
| 166 | Check Oracle Audit Policies | SELECT policy_name, enabled FROM audit_unified_enabled_policies; | Lists active unified audit policies. |
| 167 | Check Oracle Audit Trail Events | SELECT event_timestamp, dbusername, action_name, return_code FROM unified_audit_trail WHERE event_timestamp > SYSDATE-1 ORDER BY event_timestamp DESC; | Pulls recent audit events. |
| 168 | Check Oracle Scheduler Jobs | SELECT job_name, state, last_start_date, next_run_date FROM dba_scheduler_jobs; | Lists DBMS_SCHEDULER jobs. |
| 169 | Check Oracle Scheduler Job Logs | SELECT job_name, status, log_date FROM dba_scheduler_job_run_details WHERE log_date > SYSDATE-1 ORDER BY log_date DESC; | Inspects DBMS_SCHEDULER execution logs. |
| 170 | Run Oracle Scheduler Job | EXEC DBMS_SCHEDULER.RUN_JOB('NIGHTLY_BACKUP'); | Triggers immediate execution of DBMS_SCHEDULER job. |
| 171 | Check Oracle Database Parameter non-default | SELECT name, value FROM v$parameter WHERE isdefault = 'FALSE'; | Lists non-default initialization parameters. |
| 172 | Check Oracle SPFile Location | SELECT value FROM v$parameter WHERE name = 'spfile'; | Outputs path to active SPFILE binary. |
| 173 | Check Oracle Session CPU Usage | SELECT s.sid, s.username, ss.value/100 AS cpu_sec FROM v$session s JOIN v$sesstat ss ON s.sid = ss.sid JOIN v$statname sn ON ss.statistic# = sn.statistic# WHERE sn.name = 'CPU used by this session' ORDER BY ss.value DESC; | Finds sessions using highest CPU time. |
| 174 | Check Oracle Session Memory Usage | SELECT s.sid, s.username, ss.value/1024/1024 AS pga_mb FROM v$session s JOIN v$sesstat ss ON s.sid = ss.sid JOIN v$statname sn ON ss.statistic# = sn.statistic# WHERE sn.name = 'session pga memory' ORDER BY ss.value DESC; | Finds sessions using highest PGA memory. |
| 175 | Check Oracle Long Running Operations | SELECT sid, serial#, opname, target_desc, sofar, totalwork, round(sofar/totalwork*100,2) AS pct FROM v$session_longops WHERE totalwork > 0 AND sofar < totalwork; | Monitors long-running queries and utilities. |
| 176 | Check Oracle Query Ping | SELECT 1 FROM DUAL; | Simple connection ping test returning 1. |
| 177 | Check Oracle Current User | SELECT USER FROM DUAL; | Outputs active execution user account. |
| 178 | Check Oracle Current Container | SELECT SYS_CONTEXT('USERENV', 'CON_NAME') FROM DUAL; | Outputs active container PDB name. |
| 179 | Check Oracle Current DB Name | SELECT SYS_CONTEXT('USERENV', 'DB_NAME') FROM DUAL; | Outputs active database name. |
| 180 | Check Oracle Current Hostname | SELECT SYS_CONTEXT('USERENV', 'SERVER_HOST') FROM DUAL; | Outputs host server hostname. |
| 181 | Check Oracle Current Time | SELECT SYSDATE FROM DUAL; | Outputs current database server date and time. |
| 182 | Check Oracle Current Timestamp | SELECT SYSTIMESTAMP FROM DUAL; | Outputs current database server timestamp with timezone. |
| 183 | Check Oracle Database Version | SELECT * FROM v$version; | Outputs full Oracle release and build version string. |
| 184 | Check Oracle Instance Startup Time | SELECT startup_time FROM v$instance; | Outputs exact instance boot timestamp. |
| 185 | Check Oracle Listener Port TNS | SELECT value FROM v$parameter WHERE name = 'local_listener'; | Inspects local TNS listener parameter. |
| 186 | Check Oracle Database Character Set | SELECT value FROM nls_database_parameters WHERE parameter = 'NLS_CHARACTERSET'; | Outputs database character set encoding. |
| 187 | Check Oracle Database NLS Territory | SELECT value FROM nls_database_parameters WHERE parameter = 'NLS_TERRITORY'; | Outputs database territory NLS setting. |
| 188 | Check Oracle Database NLS Language | SELECT value FROM nls_database_parameters WHERE parameter = 'NLS_LANGUAGE'; | Outputs database language NLS setting. |
| 189 | Check Oracle Service Names | SELECT name FROM v$active_services; | Lists active network service names registered with listener. |
| 190 | Check Oracle Dispatchers Status | SELECT name, status, accept FROM v$dispatcher; | Inspects shared server dispatcher status. |
| 191 | Check Oracle Instance Status | SELECT instance_name, status FROM v$instance; | Inspects instance status. |
| 192 | Check Oracle Database Name | SELECT name FROM v$database; | Inspects database name. |
| 193 | Check Oracle Log Mode | SELECT log_mode FROM v$database; | Inspects archivelog mode. |
| 194 | Check Oracle Open Mode | SELECT open_mode FROM v$database; | Inspects database open mode. |
| 195 | Check Oracle DBID | SELECT dbid FROM v$database; | Inspects unique database ID. |
| 196 | Check Oracle Platform Name | SELECT platform_name FROM v$database; | Inspects OS platform name. |
| 197 | Check Oracle Controlfile Type | SELECT controlfile_type FROM v$database; | Inspects controlfile type. |
| 198 | Check Oracle Guard Status | SELECT guard_status FROM v$database; | Inspects Data Guard protection status. |
| 199 | Check Oracle Flashback Status | SELECT flashback_on FROM v$database; | Inspects flashback status. |
| 200 | Check Oracle Instance Startup | SELECT startup_time FROM v$instance; | Inspects instance boot time. |
IBM Db2 z/OS OLTP
Technical Architecture & Overview
IBM Db2 z/OS is a enterprise database management system engineered for IBM Z mainframes. It features extreme availability, tight integration with z/OS (WLM, Parallel Sysplex, Cross-System Coupling Facility), massive scalability, and hybrid transaction/analytical processing (HTAP) with the IBM Db2 Analytics Accelerator (IDAA).
Primary Use Cases: Core mainframe transaction processing, banking ledger systems, insurance claim processing, and enterprise data warehousing.
Core Components: DSN1 Subsystem, Buffer Pools (BP0-BP80), Group Buffer Pools (GBP), Distributed Data Facility (DDF), VSAM Datasets, and System Catalog SYSIBM.
Exhaustive 200-command administrative, diagnostic, and operational matrix for IBM Db2 z/OS.
| # | Operation / Action | Db2 Console / SQL Syntax | Description |
|---|---|---|---|
| 1 | Start Db2 Subsystem | -START DB2 SUBSYS(DSN1) | Boots Db2 z/OS instance. |
| 2 | Stop Db2 Subsystem | -STOP DB2 ACCESS(FORCE) | Halts Db2 z/OS instance. |
| 3 | Display Subsystem Status | -DISPLAY SUBSYS | Inspects operational subsystem state. |
| 4 | Display Active Threads | -DISPLAY THREAD(*) | Views connected application threads. |
| 5 | Cancel Thread | -CANCEL THREAD(1245) | Terminates active thread. |
| 6 | Start Database Space | -START DATABASE(DSNDB04) SPACENAM(USERTBL) ACCESS(RW) | Opens tablespace read-write. |
| 7 | Stop Database Space | -STOP DATABASE(DSNDB04) SPACENAM(USERTBL) | Closes tablespace access. |
| 8 | Run Image Copy Utility | COPY TABLESPACE DSNDB04.USERTBL COPYDDN(COPY1) | Backs up Db2 tablespace. |
| 9 | Run Reorg Utility | REORG TABLESPACE DSNDB04.USERTBL | Defragments dataset storage. |
| 10 | Run Runstats Utility | RUNSTATS TABLESPACE DSNDB04.USERTBL TABLE(ALL) INDEX(ALL) | Refreshes optimizer statistics. |
| 11 | Run Check Index | CHECK INDEX (DSNDB04.IX01) | Validates index consistency. |
| 12 | Create Database | CREATE DATABASE PRODDB BUFFERPOOL BP1; | Provisions Db2 database. |
| 13 | Create Tablespace | CREATE TABLESPACE USERTBL IN PRODDB SEGSIZE 32; | Provisions logical tablespace. |
| 14 | Create Table | CREATE TABLE USERTBL.EMPLOYEES (EMPNO CHAR(6) NOT NULL); | Provisions table schema. |
| 15 | Create Index | CREATE UNIQUE INDEX USERTBL.XEMP1 ON USERTBL.EMPLOYEES(EMPNO); | Provisions unique index. |
| 16 | Grant Authority | GRANT SELECT ON TABLE USERTBL.EMPLOYEES TO PUBLIC; | Assigns table access rights. |
| 17 | Explain Plan | EXPLAIN STMT; SELECT * FROM USERTBL.EMPLOYEES; | Generates query optimization plan. |
| 18 | Display Archive Log | -DISPLAY LOG | Inspects active logging status. |
| 19 | Archive Log Switch | -ARCHIVE LOG | Forces active log file archive. |
| 20 | Display Traces | -DISPLAY TRACE(*) | Inspects performance monitor traces. |
| 21 | Start Trace | -START TRACE (PERF) CLASS(1,2,3) | Activates performance data collection. |
| 22 | Stop Trace | -STOP TRACE (PERF) | Halts performance trace collection. |
| 23 | Display Buffer Pools | -DISPLAY BUFFERPOOL(BP1) DETAIL | Inspects buffer pool cache hit ratios. |
| 24 | Alter Buffer Pool Size | -ALTER BUFFERPOOL(BP1) VPSIZE(50000) | Modifies virtual buffer pool RAM. |
| 25 | Recover Table Space | RECOVER TABLESPACE PRODDB.USERTBL TOCOPY LAST | Recovers corrupted tablespace. |
| 26 | Bind Application Package | BIND PACKAGE(PRODCOLL) MEMBER(PRODPROG) QUALIFIER(PRODSCH) | Binds static SQL application package. |
| 27 | Free Package | FREE PACKAGE(PRODCOLL.PRODPROG(V1)) | Removes application package. |
| 28 | Check Workfile Usage | -DISPLAY FUNCTION SPECIFIC(*) | Inspects sorting workfile usage. |
| 29 | Display Storage Groups | SELECT SGNAME FROM SYSIBM.SYSSTOGROUP; | Lists VSAM storage groups. |
| 30 | Display System Parameters | -DISPLAY ZPARM | Inspects subsystem tuning parameters. |
| 31 | Start Database Read-Only | -START DATABASE(PRODDB) SPACENAM(*) ACCESS(RO) | Opens database in read-only mode. |
| 32 | Start Database Utility Mode | -START DATABASE(PRODDB) SPACENAM(*) ACCESS(UT) | Opens database for utility jobs only. |
| 33 | Display Database Status | -DISPLAY DATABASE(PRODDB) SPACENAM(*) | Inspects operational status of tablespaces. |
| 34 | Display Restricted Spaces | -DISPLAY DATABASE(*) SPACENAM(*) RESTRICT | Lists tablespaces in advisory or execution lock. |
| 35 | Modify Buffer Pool Sequential Threshold | -ALTER BUFFERPOOL(BP1) VPSEQT(80) | Adjusts sequential prefetch threshold. |
| 36 | Display Group Buffer Pool | -DISPLAY BUFFERPOOL(GBP1) GBPDB2 | Inspects data sharing group buffer pool. |
| 37 | Start Trace Accounting | -START TRACE (ACCT) CLASS(1,2,3) DEST(SMF) | Activates SMF accounting data logging. |
| 38 | Stop Trace Accounting | -STOP TRACE (ACCT) | Halts SMF accounting data collection. |
| 39 | Display Location | -DISPLAY LOCATION | Inspects distributed DDF connection locations. |
| 40 | Start DDF Daemon | -START DDF | Boots Distributed Data Facility daemon. |
| 41 | Stop DDF Daemon | -STOP DDF MODE(QUIESCE) | Gracefully stops DDF networking service. |
| 42 | Display DDF Detail | -DISPLAY DDF DETAIL | Inspects active TCP/IP port and thread usage. |
| 43 | Cancel DDF Thread | -CANCEL DDF THREAD(1245) | Terminates remote network SQL thread. |
| 44 | Run Load Utility | LOAD DATA INFILE 'DSN.DATA' INTO TABLE USERTBL.EMPLOYEES | Bulk ingests sequential dataset into table. |
| 45 | Run Unload Utility | UNLOAD TABLESPACE PRODDB.USERTBL PUNCHDDN(SYSPUNCH) UNLDDN(SYSREC) | Exports tablespace rows to dataset. |
| 46 | Run Check Data Utility | CHECK DATA TABLESPACE PRODDB.USERTBL FOR EXCEPTION DELETE | Validates referential integrity constraint rules. |
| 47 | Run Repair Utility | REPAIR SET TABLESPACE PRODDB.USERTBL NOCHECKPEND | Resets check pending status flags. |
| 48 | Run Quiesce Utility | QUIESCE TABLESPACE PRODDB.USERTBL | Forces point-in-time write commit across tablespaces. |
| 49 | Run Modify Utility | MODIFY RECOVERY TABLESPACE PRODDB.USERTBL DELETE AGE(30) | Purges obsolete image copy records from SYSCOPY. |
| 50 | Display RLST | -DISPLAY RLST | Inspects Resource Limit Specification Table (governor). |
| 51 | Start RLST Governor | -START RLST ID=01 | Activates SQL CPU governor limits. |
| 52 | Stop RLST Governor | -STOP RLST | Deactivates SQL CPU governor limits. |
| 53 | Create Storage Group | CREATE STOGROUP SGPROD VOLUMES ('VOL01','VOL02') VCAT DSN1; | Provisions VSAM storage group. |
| 54 | Alter Storage Group | ALTER STOGROUP SGPROD ADD VOLUMES ('VOL03'); | Appends volume serial to storage group. |
| 55 | Drop Storage Group | DROP STOGROUP SGPROD; | Deletes VSAM storage group definition. |
| 56 | Create Table Space Partitioned | CREATE TABLESPACE TS01 IN PRODDB NUMPARTS 4 (PART 1 BUFFERPOOL BP1); | Provisions partitioned tablespace. |
| 57 | Alter Table Space Max partitions | ALTER TABLESPACE PRODDB.TS01 MAXPARTITIONS 64; | Converts tablespace to Partition-By-Growth. |
| 58 | Alter Table Compress | ALTER TABLESPACE PRODDB.TS01 COMPRESS YES; | Enforces hardware dictionary data compression. |
| 59 | Create Index Partitioned | CREATE INDEX USERTBL.XEMP1 ON USERTBL.EMPLOYEES(EMPNO) PARTITION BY PART 1 VALUES ('100000'); | Provisions partitioned index. |
| 60 | Alter Index Rebuild | ALTER INDEX USERTBL.XEMP1 REBUILD; | Rebuilds index tree structure. |
| 61 | Grant SYSADM Authority | GRANT SYSADM TO USER JLAWREN; | Assigns full Db2 system admin authority. |
| 62 | Grant DBADM Authority | GRANT DBADM ON DATABASE PRODDB TO USER JLAWREN; | Assigns database administrator rights. |
| 63 | Revoke SYSADM Authority | REVOKE SYSADM FROM USER JLAWREN; | Revokes system admin authority. |
| 64 | Display Utility Job | -DISPLAY UTILITY(*) | Inspects active running batch utilities. |
| 65 | Term Utility Job | -TERM UTILITY(JLAWREN.JOB100) | Terminates hung or failed utility job. |
| 66 | Restart Utility Job | RESTART UTILITY(JLAWREN.JOB100) | Resumes interrupted utility job from last checkpoint. |
| 67 | Bind Plan | BIND PLAN(PLANPROD) PKLIST(PRODCOLL.*) ACTION(REPLACE) | Binds static packages into executable plan. |
| 68 | Free Plan | FREE PLAN(PLANPROD) | Deletes static plan from subsystem. |
| 69 | Rebind Package | REBIND PACKAGE(PRODCOLL.PRODPROG) | Recompiles static SQL package against new stats. |
| 70 | Rebind Plan | REBIND PLAN(PLANPROD) | Recompiles static execution plan. |
| 71 | Check Catalog Tables | SELECT NAME, CREATOR FROM SYSIBM.SYSTABLES WHERE DBName='PRODDB'; | Inspects Db2 system catalog. |
| 72 | Check Catalog Columns | SELECT NAME, COLTYPE, LENGTH FROM SYSIBM.SYSCOLUMNS WHERE TBNAME='EMPLOYEES'; | Inspects column definitions in catalog. |
| 73 | Check Catalog Indexes | SELECT NAME, TBNAME, UNIQUERULE FROM SYSIBM.SYSINDEXES WHERE TBNAME='EMPLOYEES'; | Inspects index definitions in catalog. |
| 74 | Check Catalog Tablespaces | SELECT NAME, DBNAME, NTOTAL FROM SYSIBM.SYSTABLESPACE WHERE DBNAME='PRODDB'; | Inspects tablespace storage pages. |
| 75 | Check Catalog Copies | SELECT DSNAME, DATE, START_LBN FROM SYSIBM.SYSCOPY WHERE DBNAME='PRODDB'; | Inspects image copy backup history. |
| 76 | Check Catalog Packages | SELECT NAME, COLLID, VERSION FROM SYSIBM.SYSPACKAGE WHERE COLLID='PRODCOLL'; | Inspects bound static packages. |
| 77 | Check Catalog Plans | SELECT NAME, CREATOR, BOUNDTIME FROM SYSIBM.SYSPLAN WHERE NAME='PLANPROD'; | Inspects bound static plans. |
| 78 | Check Catalog Volume Space | SELECT NAME, SPACE FROM SYSIBM.SYSTABLEPART WHERE DBNAME='PRODDB'; | Inspects partition disk page usage. |
| 79 | Check Catalog Locks | SELECT * FROM SYSIBM.SYSLOCKS; | Inspects active subsystem locks. |
| 80 | Set Current SQLID | SET CURRENT SQLID = 'PRODGRP'; | Changes active primary authorization ID for DDL. |
| 81 | Set Current Degree | SET CURRENT DEGREE = 'ANY'; | Enables parallel processing for dynamic SQL. |
| 82 | Set Current Rules | SET CURRENT RULES = 'DB2'; | Enforces native Db2 syntax rules. |
| 83 | Set Current Precision | SET CURRENT PRECISION = 'DEC31'; | Configures BCD decimal math precision. |
| 84 | Display Archive Log Status | -DISPLAY ARCHIVE | Inspects status of archive log datasets. |
| 85 | Display Profile | -DISPLAY PROFILE | Inspects active performance profiling configurations. |
| 86 | Start Profile | -START PROFILE | Activates dynamic SQL performance monitoring. |
| 87 | Stop Profile | -STOP PROFILE | Halts dynamic SQL performance monitoring. |
| 88 | Display Accelerator | -DISPLAY ACCEL(*) | Inspects IBM Db2 Analytics Accelerator (IDAA) hardware. |
| 89 | Start Accelerator | -START ACCEL(IDAA01) | Boots IDAA analytics accelerator appliance. |
| 90 | Stop Accelerator | -STOP ACCEL(IDAA01) | Halts IDAA analytics accelerator appliance. |
| 91 | Display Function | -DISPLAY FUNCTION(*) | Inspects active user-defined routines. |
| 92 | Start Function | -START FUNCTION(PRODSCH.*) | Enables user-defined function execution. |
| 93 | Stop Function | -STOP FUNCTION(PRODSCH.*) | Disables user-defined function execution. |
| 94 | Display Procedure | -DISPLAY PROCEDURE(*) | Inspects active stored procedures. |
| 95 | Start Procedure | -START PROCEDURE(PRODSCH.*) | Enables stored procedure execution. |
| 96 | Stop Procedure | -STOP PROCEDURE(PRODSCH.*) | Disables stored procedure execution. |
| 97 | Display Claimers | -DISPLAY DATABASE(PRODDB) CLAIMERS | Identifies threads claiming locks on space. |
| 98 | Check Locks Detail | -DISPLAY DATABASE(PRODDB) LOCKS | Inspects detailed page and row lock states. |
| 99 | Check Subsystem Version | SELECT VERSION FROM SYSIBM.SYSENVIRONMENT; | Outputs running Db2 z/OS release version. |
| 100 | Display Storage Group Detail | -DISPLAY GROUP | Inspects data sharing group subsystem state. |
| 101 | Display DDF Detail Network | -DISPLAY DDF DETAIL | Inspects IP addresses, port numbers, and active DDF threads. |
| 102 | Start DDF Network Service | -START DDF | Boots Distributed Data Facility network listener. |
| 103 | Stop DDF Network Service | -STOP DDF MODE(QUIESCE) | Gracefully stops DDF network connections. |
| 104 | Display Archive Log Details | -DISPLAY LOG | Inspects active log dataset names and current LSN byte range. |
| 105 | Display Buffer Pool Detail Stats | -DISPLAY BUFFERPOOL(BP1) LIST(*) | Inspects page getpages, read I/O, and write I/O per tablespace. |
| 106 | Display Group Buffer Pool Detail | -DISPLAY BUFFERPOOL(GBP1) GBPCACHE(ALL) | Inspects coupling facility GBP hit ratios in Data Sharing. |
| 107 | Display Active Traces | -DISPLAY TRACE | Lists active SMF performance and accounting traces. |
| 108 | Start Performance Trace Class 3 | -START TRACE(PERF) CLASS(3) DEST(SMF) | Activates class 3 performance lock tracing. |
| 109 | Stop Performance Trace | -STOP TRACE(PERF) | Halts active performance trace collection. |
| 110 | Display Database Lock Detail | -DISPLAY DATABASE(PRODDB) SPACENAM(*) LOCKS | Lists page, row, and table locks held across spaces. |
| 111 | Display Database Claimers | -DISPLAY DATABASE(PRODDB) SPACENAM(*) CLAIMERS | Identifies threads holding claims on tablespaces. |
| 112 | Display Thread Detail | -DISPLAY THREAD(*) DETAIL | Outputs execution details and active SQL text for thread. |
| 113 | Cancel Thread Force | -CANCEL THREAD(1245) FORCE | Hard-terminates blocking thread immediately. |
| 114 | Run Image Copy Full Utility | COPY TABLESPACE PRODDB.TS01 FULL YES COPYDDN(COPY1) | Executes full image copy backup to dataset. |
| 115 | Run Image Copy Incremental Utility | COPY TABLESPACE PRODDB.TS01 FULL NO COPYDDN(COPY1) | Executes incremental image copy backup. |
| 116 | Run Reorg Table Space Utility | REORG TABLESPACE PRODDB.TS01 SHRLEVEL CHANGE | Defragments tablespace without blocking concurrent writes. |
| 117 | Run Runstats Table Space Utility | RUNSTATS TABLESPACE PRODDB.TS01 TABLE(ALL) INDEX(ALL) SHRLEVEL CHANGE | Updates system catalog statistics online. |
| 118 | Run Check Data Utility | CHECK DATA TABLESPACE PRODDB.TS01 FOR EXCEPTION | Validates referential integrity constraint rules. |
| 119 | Run Check Index Utility | CHECK INDEX (ALL) TABLESPACE PRODDB.TS01 | Scans index pages for structural corruption. |
| 120 | Run Repair Set Utility | REPAIR SET TABLESPACE PRODDB.TS01 NOCHECKPEND | Resets check pending status flag. |
| 121 | Run Quiesce Table Space Utility | QUIESCE TABLESPACE PRODDB.TS01 | Enforces write flush and records log LSN point. |
| 122 | Run Modify Recovery Utility | MODIFY RECOVERY TABLESPACE PRODDB.TS01 DELETE AGE(60) | Purges image copy records older than 60 days. |
| 123 | Display RLST Table | -DISPLAY RLST | Inspects active Resource Limit Specification Table ID. |
| 124 | Start RLST Table | -START RLST ID=01 | Activates SQL CPU governor rules from RLST 01. |
| 125 | Stop RLST Table | -STOP RLST | Deactivates SQL CPU governor rules. |
| 126 | Bind Package Replace | BIND PACKAGE(PRODCOLL) MEMBER(PRODPROG) ACTION(REPLACE) ISOLATION(CS) | Binds static package with Cursor Stability. |
| 127 | Free Package Version | FREE PACKAGE(PRODCOLL.PRODPROG.(V1)) | Deletes static package version from catalog. |
| 128 | Rebind Package Version | REBIND PACKAGE(PRODCOLL.PRODPROG) | Recompiles static package execution paths. |
| 129 | Check Catalog Tablespace Pages | SELECT NAME, NACTIVE FROM SYSIBM.SYSTABLESPACE WHERE DBNAME='PRODDB'; | Inspects total allocated pages in tablespace. |
| 130 | Check System Subsystem Version | SELECT VERSION FROM SYSIBM.SYSENVIRONMENT; | Outputs Db2 z/OS subsystem release and version string. |
| 131 | Display Storage Group Detail | -DISPLAY GROUP | Inspects data sharing group subsystem state. |
| 132 | Check Catalog Database List | SELECT NAME, CREATOR, STOGROUP FROM SYSIBM.SYSDATABASES; | Lists all databases defined in catalog. |
| 133 | Check Catalog Tablespace Detail | SELECT NAME, DBNAME, PAGESIZE, BUFFERPOOL FROM SYSIBM.SYSTABLESPACE; | Inspects page size and buffer pool for tablespaces. |
| 134 | Check Catalog Tables Count | SELECT COUNT(*) FROM SYSIBM.SYSTABLES; | Counts total tables defined in system catalog. |
| 135 | Check Catalog Indexes Count | SELECT COUNT(*) FROM SYSIBM.SYSINDEXES; | Counts total indexes defined in system catalog. |
| 136 | Check Catalog Foreign Keys | SELECT RELNAME, TBNAME, REFTBNAME FROM SYSIBM.SYSRELS; | Lists foreign key relationships in system catalog. |
| 137 | Check Catalog Views List | SELECT NAME, CREATOR FROM SYSIBM.SYSVIEWS; | Lists views defined in system catalog. |
| 138 | Check Catalog Triggers List | SELECT NAME, SCHEMA, TBNAME FROM SYSIBM.SYSTRIGGERS; | Lists triggers defined in system catalog. |
| 139 | Check Catalog Routines List | SELECT NAME, SCHEMA, ROUTINETYPE FROM SYSIBM.SYSROUTINES; | Lists stored procedures and UDFs in system catalog. |
| 140 | Check Catalog Synonyms List | SELECT NAME, TBNAME FROM SYSIBM.SYSSYNONYMS; | Lists synonyms defined in system catalog. |
| 141 | Check Catalog User Authorizations | SELECT GRANTEE, AUTHHOWGOT FROM SYSIBM.SYSUSERAUTH; | Lists system authorization privileges assigned to users. |
| 142 | Check Catalog DB Authorizations | SELECT GRANTEE, DBNAME, DBADMAUTH FROM SYSIBM.SYSDBAUTH; | Lists database administrative privileges. |
| 143 | Check Catalog Table Authorizations | SELECT GRANTEE, TBNAME, SELECTAUTH FROM SYSIBM.TABAUTH; | Lists table read privileges in system catalog. |
| 144 | Check Catalog Package Authorizations | SELECT GRANTEE, PACKNAME, EXECUTEAUTH FROM SYSIBM.SYSPACKAUTH; | Lists package execution privileges in system catalog. |
| 145 | Check Catalog Plan Authorizations | SELECT GRANTEE, PLANNAME, EXECUTEAUTH FROM SYSIBM.SYSPLANAUTH; | Lists plan execution privileges in system catalog. |
| 146 | Check Catalog Buffer Pool List | SELECT BPNAME, VPSIZE FROM SYSIBM.SYSBUFFERPOOLS; | Lists buffer pool configurations. |
| 147 | Check Catalog Storage Group List | SELECT NAME, VOLID FROM SYSIBM.SYSVOLUMES; | Lists DASD volume serials in storage groups. |
| 148 | Check Catalog Image Copy List | SELECT DBNAME, TSNAME, DATE, START_LBN FROM SYSIBM.SYSCOPY ORDER BY DATE DESC; | Lists historical image copies in catalog. |
| 149 | Check Catalog Utility Status | SELECT UTILID, STATE FROM SYSIBM.SYSUTIL; | Lists active utility execution states in catalog. |
| 150 | Check Catalog Pending Status | SELECT DBNAME, NAME, STAT TYPE FROM SYSIBM.SYSPENDING; | Lists tablespaces in advisory pending status. |
| 151 | Check Catalog LOB Table Spaces | SELECT NAME, DBNAME FROM SYSIBM.SYSTABLESPACE WHERE TYPE='LOB'; | Lists LOB tablespaces in system catalog. |
| 152 | Check Catalog XML Table Spaces | SELECT NAME, DBNAME FROM SYSIBM.SYSTABLESPACE WHERE TYPE='XML'; | Lists XML tablespaces in system catalog. |
| 153 | Check Catalog Partition Storage | SELECT DBNAME, TSNAME, PARTITION, PQTY, SQTY FROM SYSIBM.SYSTABLEPART; | Inspects primary/secondary VSAM allocation quantities. |
| 154 | Check Catalog Index Partition Storage | SELECT IXNAME, PARTITION, PQTY, SQTY FROM SYSIBM.SYSINDEXPART; | Inspects index partition VSAM allocation quantities. |
| 155 | Check Catalog Plan Statements | SELECT PLANNAME, STMTNO, TEXT FROM SYSIBM.SYSSTMT; | Inspects static SQL statement text bound to plans. |
| 156 | Check Catalog Package Statements | SELECT PKGNAME, STMTNO, TEXT FROM SYSIBM.SYSPACKSTMT; | Inspects static SQL statement text bound to packages. |
| 157 | Check Catalog DDF Locations | SELECT LINKNAME, IPADDR, PORT FROM SYSIBM.SYSLUNAMES; | Inspects remote location network addresses in catalog. |
| 158 | Check Catalog DDF User Mappings | SELECT USERNM, RECORGNM FROM SYSIBM.SYSUSERNAMES; | Inspects inbound remote user authentication mappings. |
| 159 | Check Catalog System Parameters | SELECT ZPARM_NAME, ZPARM_VALUE FROM SYSIBM.SYSZPARMS; | Inspects system parameter overrides. |
| 160 | Check Db2 Subsystem Name | SELECT SUBSYSTEM_NAME FROM SYSIBM.SYSENVIRONMENT; | Outputs active Db2 subsystem name. |
| 161 | Check Db2 Workload Manager Class | SELECT WLM_ENV FROM SYSIBM.SYSROUTINES WHERE WLM_ENV IS NOT NULL; | Lists z/OS WLM environment names for stored procedures. |
| 162 | Check Db2 Coupling Facility Locks | SELECT * FROM SYSIBM.SYSLOCKS WHERE LOCK_TYPE='GBP'; | Inspects group buffer pool coupling facility locks. |
| 163 | Check Db2 Log Buffer Size | SELECT VALUE FROM SYSIBM.SYSZPARMS WHERE ZPARM_NAME='OUTBUFF'; | Inspects output log buffer RAM size. |
| 164 | Check Db2 Max Remote Connections | SELECT VALUE FROM SYSIBM.SYSZPARMS WHERE ZPARM_NAME='CONDBAT'; | Inspects max concurrent remote DDF threads. |
| 165 | Check Db2 Max Active Users | SELECT VALUE FROM SYSIBM.SYSZPARMS WHERE ZPARM_NAME='CTHREAD'; | Inspects max concurrent allied threads. |
| 166 | Check Db2 Lock Timeout Parameter | SELECT VALUE FROM SYSIBM.SYSZPARMS WHERE ZPARM_NAME='IRLMRLT'; | Inspects IRLM lock wait timeout seconds. |
| 167 | Check Db2 Deadlock Timeout Parameter | SELECT VALUE FROM SYSIBM.SYSZPARMS WHERE ZPARM_NAME='DEADLOCK'; | Inspects IRLM deadlock detection interval milliseconds. |
| 168 | Check Db2 Checkpoint Frequency Parameter | SELECT VALUE FROM SYSIBM.SYSZPARMS WHERE ZPARM_NAME='CHKFREQ'; | Inspects checkpoint frequency in log records or minutes. |
| 169 | Check Db2 Max Storage Files Per Space | SELECT VALUE FROM SYSIBM.SYSZPARMS WHERE ZPARM_NAME='MAXCAP'; | Inspects maximum VSAM datasets per tablespace. |
| 170 | Check Db2 Archive Log Destination 1 | SELECT VALUE FROM SYSIBM.SYSZPARMS WHERE ZPARM_NAME='ARCLOG1'; | Inspects primary archive log dataset prefix. |
| 171 | Check Db2 Archive Log Destination 2 | SELECT VALUE FROM SYSIBM.SYSZPARMS WHERE ZPARM_NAME='ARCLOG2'; | Inspects secondary archive log dataset prefix. |
| 172 | Check Db2 System Uptime Timestamp | SELECT START_TIME FROM SYSIBM.SYSENVIRONMENT; | Outputs subsystem startup timestamp. |
| 173 | Check Db2 Query Ping | SELECT 1 FROM SYSIBM.SYSDUMMY1; | Simple connection ping query against SYSDUMMY1. |
| 174 | Check Db2 Current Date | SELECT CURRENT DATE FROM SYSIBM.SYSDUMMY1; | Returns current z/OS system date. |
| 175 | Check Db2 Current Time | SELECT CURRENT TIME FROM SYSIBM.SYSDUMMY1; | Returns current z/OS system time. |
| 176 | Check Db2 Current Timestamp | SELECT CURRENT TIMESTAMP FROM SYSIBM.SYSDUMMY1; | Returns current z/OS system timestamp. |
| 177 | Check Db2 Current User | SELECT USER FROM SYSIBM.SYSDUMMY1; | Returns active execution user primary auth ID. |
| 178 | Check Db2 Current SQLID | SELECT CURRENT SQLID FROM SYSIBM.SYSDUMMY1; | Returns active current SQLID for DDL. |
| 179 | Check Db2 Current Server Name | SELECT CURRENT SERVER FROM SYSIBM.SYSDUMMY1; | Returns active subsystem location name. |
| 180 | Check Db2 Current Timezone | SELECT CURRENT TIMEZONE FROM SYSIBM.SYSDUMMY1; | Returns active system timezone offset. |
| 181 | Check Db2 Current Schema | SELECT CURRENT SCHEMA FROM SYSIBM.SYSDUMMY1; | Returns active default schema name. |
| 182 | Check Db2 Current Package Version | SELECT CURRENT PACKAGE VERSION FROM SYSIBM.SYSDUMMY1; | Returns active running package version string. |
| 183 | Check Db2 Current Precision | SELECT CURRENT PRECISION FROM SYSIBM.SYSDUMMY1; | Returns active decimal math precision setting. |
| 184 | Check Db2 Current Rules | SELECT CURRENT RULES FROM SYSIBM.SYSDUMMY1; | Returns active SQL rules mode (DB2 vs STD). |
| 185 | Check Db2 Current Degree | SELECT CURRENT DEGREE FROM SYSIBM.SYSDUMMY1; | Returns active query parallelism degree. |
| 186 | Check Db2 Current Application Encoding | SELECT CURRENT APPLICATION ENCODING SCHEME FROM SYSIBM.SYSDUMMY1; | Returns active EBCDIC or ASCII encoding scheme. |
| 187 | Check Db2 Subsystem Build Level | SELECT GETVARIABLE('SYSIBM.VERSION') FROM SYSIBM.SYSDUMMY1; | Outputs exact Db2 z/OS version string (DSN13010). |
| 188 | Check Db2 Subsystem Code Page | SELECT GETVARIABLE('SYSIBM.SYSTEM_EBCDIC_CCSID') FROM SYSIBM.SYSDUMMY1; | Outputs system EBCDIC code page number. |
| 189 | Check Db2 Subsystem Timezone Name | SELECT GETVARIABLE('SYSIBM.TIMEZONE_NAME') FROM SYSIBM.SYSDUMMY1; | Outputs system IANA timezone name. |
| 190 | Check Db2 Subsystem Host Name | SELECT GETVARIABLE('SYSIBM.HOSTNAME') FROM SYSIBM.SYSDUMMY1; | Outputs mainframe z/OS LPAR host name. |
| 191 | Check Db2 Subsystem IP Address | SELECT GETVARIABLE('SYSIBM.IPADDR') FROM SYSIBM.SYSDUMMY1; | Outputs primary IP address of mainframe DDF listener. |
| 192 | Check Db2 Subsystem Job Name | SELECT GETVARIABLE('SYSIBM.JOB_NAME') FROM SYSIBM.SYSDUMMY1; | Outputs active batch job name or DSN1MSTR task name. |
| 193 | Check Db2 Subsystem Job ID | SELECT GETVARIABLE('SYSIBM.JOB_ID') FROM SYSIBM.SYSDUMMY1; | Outputs active JES2 job ID. |
| 194 | Check Db2 Subsystem Step Name | SELECT GETVARIABLE('SYSIBM.STEP_NAME') FROM SYSIBM.SYSDUMMY1; | Outputs active job step name. |
| 195 | Check Db2 Subsystem User Name | SELECT GETVARIABLE('SYSIBM.USER_NAME') FROM SYSIBM.SYSDUMMY1; | Outputs authenticated RACF/ACF2 user ID. |
| 196 | Check Db2 Subsystem Client IP | SELECT GETVARIABLE('SYSIBM.CLIENT_IPADDR') FROM SYSIBM.SYSDUMMY1; | Outputs remote client IP address. |
| 197 | Check Db2 Subsystem Client App Name | SELECT GETVARIABLE('SYSIBM.CLIENT_APPLNAME') FROM SYSIBM.SYSDUMMY1; | Outputs remote client application name. |
| 198 | Check Db2 Subsystem Client User Name | SELECT GETVARIABLE('SYSIBM.CLIENT_USERID') FROM SYSIBM.SYSDUMMY1; | Outputs remote client user ID. |
| 199 | Check Db2 Subsystem Client Workstation Name | SELECT GETVARIABLE('SYSIBM.CLIENT_WRKSTNNAME') FROM SYSIBM.SYSDUMMY1; | Outputs remote workstation host name. |
| 200 | Verify Db2 Ping Connection | SELECT 1 FROM SYSIBM.SYSDUMMY1; | Verifies active connection to Db2 subsystem. |
MariaDB OLTP
Technical Architecture & Overview
MariaDB is an open-source relational database created by the original developers of MySQL. It expands traditional relational capabilities with modern pluggable storage engines (InnoDB, Aria, ColumnStore, MyRocks, Spider), temporal system-versioning tables, sequence objects, and Galera multi-master synchronous clustering.
Primary Use Cases: Web application transactions, high-concurrency OLTP, columnar real-time analytics (ColumnStore), temporal auditing, and multi-master scale-out clusters.
Core Components: Server Daemon (mariadbd), Aria Engine, InnoDB Buffer Pool, Galera Replication Plugin (wsrep), ColumnStore Analytics Engine, and Binary Logs.
Exhaustive 200-command administrative, diagnostic, and operational matrix for MariaDB.
| # | Operation / Action | SQL / CLI Syntax | Description |
|---|---|---|---|
| 1 | Start MariaDB Daemon | sudo systemctl start mariadb | Boots MariaDB server service. |
| 2 | Stop MariaDB Daemon | sudo systemctl stop mariadb | Stops MariaDB server service. |
| 3 | Interactive Console | mariadb -u root -p | Opens administrative SQL monitor. |
| 4 | Logical Backup | mariadb-dump -u root -p --all-databases > all_dbs.sql | Exports database cluster dump. |
| 5 | Restore Dump | mariadb -u root -p enterprise_db < all_dbs.sql | Restores SQL backup dump. |
| 6 | Check Aria Engine Status | SHOW ENGINE ARIARUNNING STATUS; | Inspects Aria storage engine metrics. |
| 7 | Inspect Active Processes | SHOW PROCESSLIST; | Views running client connections. |
| 8 | Kill Query Thread | KILL QUERY 832; | Terminates long-running query. |
| 9 | Create Database | CREATE DATABASE enterprise_db CHARACTER SET utf8mb4; | Provisions new database. |
| 10 | Drop Database | DROP DATABASE enterprise_db; | Deletes database instance. |
| 11 | Create User | CREATE USER 'app_user'@'localhost' IDENTIFIED BY 'SecurePass!'; | Provisions database user. |
| 12 | Grant Access Privileges | GRANT ALL PRIVILEGES ON enterprise_db.* TO 'app_user'@'localhost'; | Assigns database rights. |
| 13 | Analyze Table | ANALYZE TABLE users; | Refreshes index statistics. |
| 14 | Optimize Table | OPTIMIZE TABLE users; | Defragments Aria/InnoDB storage. |
| 15 | Check Table Integrity | CHECK TABLE users EXTENDED; | Performs deep table corruption scan. |
| 16 | Repair Table | REPAIR TABLE users; | Repairs corrupted table file. |
| 17 | Explain Query Plan | EXPLAIN SELECT * FROM users WHERE status = 'active'; | Evaluates query execution strategy. |
| 18 | Show Status Variables | SHOW GLOBAL STATUS LIKE 'Conn%'; | Inspects connection counters. |
| 19 | Show System Variables | SHOW VARIABLES LIKE 'innodb_buffer_pool_size'; | Inspects configuration parameters. |
| 20 | Set Runtime Variable | SET GLOBAL max_allowed_packet = 67108864; | Modifies network buffer limit. |
| 21 | Check Replication Status | SHOW ALL SLAVES STATUS; | Inspects multi-source replication sync. |
| 22 | Reset Replica | RESET SLAVE; | Clears replication configurations. |
| 23 | Change Replication Master | CHANGE MASTER TO MASTER_HOST='10.0.0.10'; | Sets replication upstream source. |
| 24 | Create Index | CREATE INDEX idx_user_status ON users(status); | Provisions new table index. |
| 25 | Drop Index | DROP INDEX idx_user_status ON users; | Removes table index. |
| 26 | Flush Table Privilege | FLUSH PRIVILEGES; | Reloads grant permission tables. |
| 27 | Show Binary Logs | SHOW BINARY LOGS; | Lists active transaction binlogs. |
| 28 | Purge Binary Logs | PURGE BINARY LOGS TO 'mariadb-bin.000450'; | Removes old transaction binlogs. |
| 29 | Check Disk Usage | SELECT table_name, data_length FROM information_schema.tables WHERE table_schema='enterprise_db'; | Calculates table storage sizes. |
| 30 | Version Inspection | SELECT VERSION(); | Outputs running MariaDB engine version. |
| 31 | Start Slave Thread | START SLAVE; | Starts replication receiver and SQL worker threads. |
| 32 | Stop Slave Thread | STOP SLAVE; | Stops replication receiver and SQL worker threads. |
| 33 | Start Named Slave | START SLAVE 'master_node2'; | Starts specific multi-source replication channel. |
| 34 | Stop Named Slave | STOP SLAVE 'master_node2'; | Stops specific multi-source replication channel. |
| 35 | Show Named Slave Status | SHOW SLAVE 'master_node2' STATUS\G | Inspects status of named replication channel. |
| 36 | Check Galera Cluster Status | SHOW STATUS LIKE 'wsrep_cluster_size'; | Inspects number of active nodes in Galera cluster. |
| 37 | Check Galera Sync State | SHOW STATUS LIKE 'wsrep_local_state_comment'; | Verifies if node is Synced in Galera cluster. |
| 38 | Check Galera Flow Control | SHOW STATUS LIKE 'wsrep_flow_control_paused'; | Monitors Galera replication flow control pause time. |
| 39 | Set Galera Desync Mode | SET GLOBAL wsrep_desync = ON; | Desynchronizes node from cluster for maintenance. |
| 40 | Re-sync Galera Node | SET GLOBAL wsrep_desync = OFF; | Re-synchronizes node with Galera cluster. |
| 41 | Check ColumnStore Status | SELECT * FROM information_schema.columnstore_tables; | Inspects MariaDB ColumnStore engine tables. |
| 42 | Create ColumnStore Table | CREATE TABLE sales_fact (id INT, amount DECIMAL(10,2)) ENGINE=ColumnStore; | Provisions analytical columnar table. |
| 43 | Create Sequence | CREATE SEQUENCE user_seq START WITH 1000 INCREMENT BY 1; | Provisions database sequence object. |
| 44 | Get Sequence Value | SELECT NEXT VALUE FOR user_seq; | Fetches next value from sequence. |
| 45 | Drop Sequence | DROP SEQUENCE user_seq; | Deletes sequence object. |
| 46 | Create Flashback Table | CREATE TABLE users_history FOR SYSTEM_TIME ALL SELECT * FROM users; | Inspects temporal table history. |
| 47 | Query System Time Travel | SELECT * FROM users FOR SYSTEM_TIME AS OF '2026-07-01 10:00:00'; | Queries historical state via system-versioning. |
| 48 | Create System-Versioned Table | CREATE TABLE users (id INT, name VARCHAR(50)) WITH SYSTEM VERSIONING; | Provisions temporal historical table. |
| 49 | Set Password Expiry | ALTER USER 'app_user'@'localhost' PASSWORD EXPIRE INTERVAL 90 DAY; | Enforces password rotation policy. |
| 50 | Lock User Account | ALTER USER 'app_user'@'localhost' ACCOUNT LOCK; | Disables user authentication. |
| 51 | Unlock User Account | ALTER USER 'app_user'@'localhost' ACCOUNT UNLOCK; | Enables user authentication. |
| 52 | Show User Grants | SHOW GRANTS FOR 'app_user'@'localhost'; | Lists all assigned permissions for user. |
| 53 | Revoke Privileges | REVOKE ALL PRIVILEGES ON enterprise_db.* FROM 'app_user'@'localhost'; | Removes permissions from user. |
| 54 | Create Role | CREATE ROLE 'app_read_role'; | Provisions security role container. |
| 55 | Grant Role to User | GRANT 'app_read_role' TO 'app_user'@'localhost'; | Assigns role to user account. |
| 56 | Set Default Role | SET DEFAULT ROLE 'app_read_role' FOR 'app_user'@'localhost'; | Activates default role on login. |
| 57 | Drop Role | DROP ROLE 'app_read_role'; | Deletes security role container. |
| 58 | Show Engines | SHOW ENGINES; | Lists supported storage engines and default state. |
| 59 | Check Aria Log File | SHOW ENGINE ARIA STATUS; | Inspects Aria recovery log state. |
| 60 | Set InnoDB Buffer Pool Size | SET GLOBAL innodb_buffer_pool_size = 4294967296; | Adjusts RAM assigned to buffer pool. |
| 61 | Set Slow Query Log | SET GLOBAL slow_query_log = 1; | Activates slow query logging. |
| 62 | Set Long Query Time | SET GLOBAL long_query_time = 1.5; | Logs queries taking over 1.5 seconds. |
| 63 | Set Max Connections | SET GLOBAL max_connections = 1000; | Increases max client connection limit. |
| 64 | Set Read Only Mode | SET GLOBAL read_only = ON; | Blocks writes for non-admin accounts. |
| 65 | Disable Read Only Mode | SET GLOBAL read_only = OFF; | Enables database write operations. |
| 66 | Create Range Partitioned Table | CREATE TABLE orders (id INT, dt DATE) PARTITION BY RANGE (YEAR(dt)) (PARTITION p0 VALUES LESS THAN (2026)); | Provisions range partition table. |
| 67 | Add Partition | ALTER TABLE orders ADD PARTITION (PARTITION p1 VALUES LESS THAN (2027)); | Appends new partition range. |
| 68 | Drop Partition | ALTER TABLE orders DROP PARTITION p0; | Deletes partition data instantly. |
| 69 | Truncate Partition | ALTER TABLE orders TRUNCATE PARTITION p1; | Clears partition records. |
| 70 | Check Partition Info | SELECT PARTITION_NAME, TABLE_ROWS FROM information_schema.PARTITIONS WHERE TABLE_NAME='orders'; | Inspects table partition metrics. |
| 71 | Create Virtual Column | ALTER TABLE users ADD COLUMN full_name VARCHAR(100) AS (CONCAT(first_name, ' ', last_name)) VIRTUAL; | Provisions computed virtual column. |
| 72 | Create Stored Column | ALTER TABLE users ADD COLUMN full_name VARCHAR(100) AS (CONCAT(first_name, ' ', last_name)) STORED; | Provisions computed persistent column. |
| 73 | Create Fulltext Index | CREATE FULLTEXT INDEX idx_ft_bio ON users(bio); | Provisions inverted index for text search. |
| 74 | Run Fulltext Search | SELECT * FROM users WHERE MATCH(bio) AGAINST('engineer' IN BOOLEAN MODE); | Executes fulltext search query. |
| 75 | Create Invisible Index | ALTER TABLE users ADD INDEX idx_status (status) INVISIBLE; | Provisions index hidden from optimizer. |
| 76 | Make Index Visible | ALTER TABLE users ALTER INDEX idx_status VISIBLE; | Restores index visibility to optimizer. |
| 77 | Show Create Table | SHOW CREATE TABLE users; | Outputs exact DDL syntax used to build table. |
| 78 | Show Create Database | SHOW CREATE DATABASE enterprise_db; | Outputs exact DDL syntax used to build DB. |
| 79 | Show Create View | SHOW CREATE VIEW v_users; | Outputs exact DDL syntax used to build view. |
| 80 | Create Trigger | CREATE TRIGGER trg_user_bi BEFORE INSERT ON users FOR EACH ROW SET NEW.created_at = NOW(); | Provisions pre-insert trigger. |
| 81 | Drop Trigger | DROP TRIGGER IF EXISTS trg_user_bi; | Deletes trigger routine. |
| 82 | Show Triggers | SHOW TRIGGERS FROM enterprise_db; | Lists all triggers in database. |
| 83 | Create Event Scheduler | CREATE EVENT ev_purge ON SCHEDULE EVERY 1 DAY DO DELETE FROM logs WHERE dt < NOW() - INTERVAL 7 DAY; | Provisions automated event. |
| 84 | Show Scheduled Events | SHOW EVENTS; | Lists all configured scheduled events. |
| 85 | Drop Scheduled Event | DROP EVENT IF EXISTS ev_purge; | Deletes scheduled event. |
| 86 | Check Table Lock Waiters | SELECT * FROM information_schema.INNODB_LOCK_WAITS; | Inspects blocking lock wait chains. |
| 87 | Check Table Locks Held | SELECT * FROM information_schema.INNODB_LOCKS; | Inspects active InnoDB locks. |
| 88 | Check Transaction Status | SELECT * FROM information_schema.INNODB_TRX; | Inspects active transactions. |
| 89 | Create Savepoint | SAVEPOINT svp_1; | Sets savepoint inside transaction. |
| 90 | Rollback to Savepoint | ROLLBACK TO SAVEPOINT svp_1; | Reverts transaction state to savepoint. |
| 91 | Release Savepoint | RELEASE SAVEPOINT svp_1; | Removes savepoint reference. |
| 92 | Check Max Allowed Packet | SELECT @@max_allowed_packet; | Inspects max network packet size threshold. |
| 93 | Check Character Sets | SHOW CHARACTER SET; | Outputs supported character set encodings. |
| 94 | Check Collations | SHOW COLLATION WHERE Charset='utf8mb4'; | Lists supported utf8mb4 collation rules. |
| 95 | Check Uptime | SHOW GLOBAL STATUS LIKE 'Uptime'; | Displays server uptime in seconds. |
| 96 | Flush Query Cache | FLUSH QUERY CACHE; | Defragments query cache memory. |
| 97 | Reset Query Cache | RESET QUERY CACHE; | Clears query cache memory contents. |
| 98 | Flush User Resources | FLUSH USER_RESOURCES; | Resets user resource limit counters. |
| 99 | Flush Error Logs | FLUSH ERROR LOGS; | Rotates error log files. |
| 100 | Shutdown Server via SQL | SHUTDOWN; | Triggers graceful server shutdown via SQL. |
| 101 | Check Galera Cluster Size Status | SHOW STATUS LIKE 'wsrep_cluster_size'; | Inspects active node count in Galera cluster. |
| 102 | Check Galera Node Sync Status | SHOW STATUS LIKE 'wsrep_local_state_comment'; | Verifies if node is Synced in Galera cluster. |
| 103 | Check Galera Flow Control Status | SHOW STATUS LIKE 'wsrep_flow_control_paused'; | Monitors replication flow control pause time. |
| 104 | Set Galera Desync Mode | SET GLOBAL wsrep_desync = ON; | Desynchronizes node for maintenance operations. |
| 105 | Set Galera Resync Mode | SET GLOBAL wsrep_desync = OFF; | Re-synchronizes node with Galera cluster. |
| 106 | Check ColumnStore Tables | SELECT * FROM information_schema.columnstore_tables; | Inspects MariaDB ColumnStore engine tables. |
| 107 | Create ColumnStore Table | CREATE TABLE sales_col (id INT, amount DECIMAL(10,2)) ENGINE=ColumnStore; | Provisions analytical columnar table. |
| 108 | Create Sequence Object | CREATE SEQUENCE user_seq START WITH 1000 INCREMENT BY 1; | Provisions database sequence object. |
| 109 | Get Sequence Next Value | SELECT NEXT VALUE FOR user_seq; | Fetches next value from sequence. |
| 110 | Drop Sequence Object | DROP SEQUENCE user_seq; | Deletes sequence object. |
| 111 | Create System-Versioned Table | CREATE TABLE users (id INT, name VARCHAR(50)) WITH SYSTEM VERSIONING; | Provisions temporal historical table. |
| 112 | Query System-Versioned Table | SELECT * FROM users FOR SYSTEM_TIME AS OF '2026-07-01 10:00:00'; | Queries historical state via system-versioning. |
| 113 | Check Aria Engine Status | SHOW ENGINE ARIA STATUS; | Inspects Aria crash-safe storage engine state. |
| 114 | Set Password Expiry Interval | ALTER USER 'app_user'@'localhost' PASSWORD EXPIRE INTERVAL 90 DAY; | Enforces password rotation policy. |
| 115 | Lock Account Login | ALTER USER 'app_user'@'localhost' ACCOUNT LOCK; | Disables user authentication. |
| 116 | Unlock Account Login | ALTER USER 'app_user'@'localhost' ACCOUNT UNLOCK; | Enables user authentication. |
| 117 | Show User Grants | SHOW GRANTS FOR 'app_user'@'localhost'; | Lists permissions assigned to user. |
| 118 | Create Role | CREATE ROLE 'app_read_role'; | Provisions security role container. |
| 119 | Grant Role to User | GRANT 'app_read_role' TO 'app_user'@'localhost'; | Assigns role to user account. |
| 120 | Drop Role | DROP ROLE 'app_read_role'; | Deletes security role container. |
| 121 | Set InnoDB Buffer Pool Size | SET GLOBAL innodb_buffer_pool_size = 4294967296; | Adjusts RAM assigned to buffer pool. |
| 122 | Set Slow Query Log | SET GLOBAL slow_query_log = 1; | Activates slow query logging. |
| 123 | Set Long Query Time | SET GLOBAL long_query_time = 1.5; | Logs queries taking over 1.5 seconds. |
| 124 | Set Max Connections | SET GLOBAL max_connections = 1000; | Increases max client connection limit. |
| 125 | Set Read Only Mode | SET GLOBAL read_only = ON; | Blocks writes for non-admin accounts. |
| 126 | Disable Read Only Mode | SET GLOBAL read_only = OFF; | Enables database write operations. |
| 127 | Check Table Lock Waiters | SELECT * FROM information_schema.INNODB_LOCK_WAITS; | Inspects blocking lock wait chains. |
| 128 | Check Active Transactions | SELECT * FROM information_schema.INNODB_TRX; | Inspects active InnoDB transactions. |
| 129 | Verify Engine Version | SELECT VERSION(); | Outputs running MariaDB engine version string. |
| 130 | Shutdown MariaDB Server | SHUTDOWN; | Gracefully shuts down MariaDB server daemon. |
| 131 | Check Galera Cluster State | SHOW STATUS LIKE 'wsrep_local_state'; | Inspects numeric state of local Galera node. |
| 132 | Check Galera Cluster Status Comment | SHOW STATUS LIKE 'wsrep_local_state_comment'; | Inspects human-readable state (Synced/Donor/Joined). |
| 133 | Check Galera Cluster Conf ID | SHOW STATUS LIKE 'wsrep_cluster_conf_id'; | Inspects cluster configuration change counter. |
| 134 | Check Galera Cluster Weight | SHOW STATUS LIKE 'wsrep_cluster_weight'; | Inspects total quorum weight of active cluster. |
| 135 | Check Galera Cluster Status Health | SHOW STATUS LIKE 'wsrep_connected'; | Verifies whether node is connected to Galera cluster. |
| 136 | Check Galera Ready Status | SHOW STATUS LIKE 'wsrep_ready'; | Verifies whether node is ready to accept SQL queries. |
| 137 | Check Galera Received Queue | SHOW STATUS LIKE 'wsrep_local_recv_queue'; | Inspects length of received replication queue. |
| 138 | Check Galera Send Queue | SHOW STATUS LIKE 'wsrep_local_send_queue'; | Inspects length of local send queue. |
| 139 | Check Galera Cert Failures | SHOW STATUS LIKE 'wsrep_local_cert_failures'; | Monitors total certification conflict transaction aborts. |
| 140 | Check Galera BF Aborts | SHOW STATUS LIKE 'wsrep_local_bf_aborts'; | Monitors brute-force transaction aborts by high priority cluster node. |
| 141 | Check Aria Page Cache Size | SHOW VARIABLES LIKE 'aria_pagecache_buffer_size'; | Inspects RAM allocated for Aria storage engine page cache. |
| 142 | Set Aria Page Cache Size | SET GLOBAL aria_pagecache_buffer_size = 1073741824; | Allocates 1GB RAM for Aria page cache. |
| 143 | Check Aria Log File Size | SHOW VARIABLES LIKE 'aria_log_file_size'; | Inspects max size of Aria transaction log files. |
| 144 | Check Aria Recover Mode | SHOW VARIABLES LIKE 'aria_recover_options'; | Inspects automatic recovery mode for corrupted Aria tables. |
| 145 | Check ColumnStore Engine Version | SELECT * FROM information_schema.plugins WHERE plugin_name='ColumnStore'; | Verifies ColumnStore plugin release version. |
| 146 | Check Sequence Cache Size | CREATE SEQUENCE seq_cached START 1 CACHE 1000; | Provisions sequence with 1000 in-memory pre-allocated IDs. |
| 147 | Check System Versioning Mode | SHOW VARIABLES LIKE 'system_versioning_asof'; | Inspects default system-versioning time travel mode. |
| 148 | Alter System Versioned Table Add Column | ALTER TABLE users ADD COLUMN bio TEXT; | Appends column preserving historical temporal versions. |
| 149 | Alter System Versioned Table Drop Versioning | ALTER TABLE users DROP SYSTEM VERSIONING; | Removes system-versioning tracking from table. |
| 150 | Check InnoDB Buffer Pool Instances | SHOW VARIABLES LIKE 'innodb_buffer_pool_instances'; | Inspects buffer pool shard count. |
| 151 | Check InnoDB Log File Size | SHOW VARIABLES LIKE 'innodb_log_file_size'; | Inspects size of redo log files. |
| 152 | Check Max Allowed Packet | SHOW VARIABLES LIKE 'max_allowed_packet'; | Inspects maximum allowed packet payload size. |
| 153 | Set Max Allowed Packet | SET GLOBAL max_allowed_packet = 1073741824; | Increases max packet payload size to 1GB. |
| 154 | Check Slow Query Log Location | SHOW VARIABLES LIKE 'slow_query_log_file'; | Inspects file path of slow query log. |
| 155 | Check Error Log Location | SHOW VARIABLES LIKE 'log_error'; | Inspects file path of server error log. |
| 156 | Check Query Exec Time Limit | SET SESSION max_statement_time = 10.0; | Caps SQL query execution time to 10 seconds. |
| 157 | Check Active Server Threads | SHOW GLOBAL STATUS LIKE 'Threads_running'; | Monitors active concurrent query execution threads. |
| 158 | Check Server Connection Limits | SHOW VARIABLES LIKE 'max_connections'; | Inspects maximum allowed client connections. |
| 159 | Check Server Uptime Status | SHOW GLOBAL STATUS LIKE 'Uptime'; | Displays server uptime in seconds. |
| 160 | Check Database Ping Query | SELECT 1; | Simple connection ping test returning 1. |
| 161 | Check Current User Account | SELECT CURRENT_USER(); | Returns current execution user account. |
| 162 | Check Current Database Name | SELECT DATABASE(); | Returns active selected database name. |
| 163 | Check System Timestamp | SELECT NOW(); | Returns current server timestamp. |
| 164 | Check System UTC Timestamp | SELECT UTC_TIMESTAMP(); | Returns current UTC timestamp. |
| 165 | Check Connection Thread ID | SELECT CONNECTION_ID(); | Returns current connection thread ID. |
| 166 | Check MariaDB Version Details | SELECT VERSION(); | Outputs MariaDB server build and patch version string. |
| 167 | Check Server Host Name | SHOW VARIABLES LIKE 'hostname'; | Outputs host server hostname. |
| 168 | Check Server Port Number | SHOW VARIABLES LIKE 'port'; | Outputs TCP/IP listening port number (3306). |
| 169 | Check Socket File Path | SHOW VARIABLES LIKE 'socket'; | Outputs Unix domain socket file path. |
| 170 | Check Data Directory Path | SHOW VARIABLES LIKE 'datadir'; | Outputs physical database files storage path. |
| 171 | Check Tmp Directory Path | SHOW VARIABLES LIKE 'tmpdir'; | Outputs temporary files storage path. |
| 172 | Check Open File Limit | SHOW VARIABLES LIKE 'open_files_limit'; | Outputs max OS file handles allowed for server. |
| 173 | Check Key Buffer Size (MyISAM) | SHOW VARIABLES LIKE 'key_buffer_size'; | Inspects memory allocated for MyISAM index blocks. |
| 174 | Check Read Buffer Size | SHOW VARIABLES LIKE 'read_buffer_size'; | Inspects per-thread sequential scan buffer size. |
| 175 | Check Read Rnd Buffer Size | SHOW VARIABLES LIKE 'read_rnd_buffer_size'; | Inspects per-thread sorted scan buffer size. |
| 176 | Check Sort Buffer Size | SHOW VARIABLES LIKE 'sort_buffer_size'; | Inspects per-thread ORDER BY sort buffer size. |
| 177 | Check Join Buffer Size | SHOW VARIABLES LIKE 'join_buffer_size'; | Inspects per-thread full join buffer size. |
| 178 | Check Max Heap Table Size | SHOW VARIABLES LIKE 'max_heap_table_size'; | Inspects max size for MEMORY engine tables. |
| 179 | Check Tmp Table Size | SHOW VARIABLES LIKE 'tmp_table_size'; | Inspects max size for internal in-memory temp tables. |
| 180 | Check Created Tmp Disk Tables | SHOW GLOBAL STATUS LIKE 'Created_tmp_disk_tables'; | Monitors internal temp tables spilling to disk. |
| 181 | Check Created Tmp Tables | SHOW GLOBAL STATUS LIKE 'Created_tmp_tables'; | Monitors total internal temp tables created. |
| 182 | Check Select Scan Count | SHOW GLOBAL STATUS LIKE 'Select_scan'; | Monitors full table scan execution count. |
| 183 | Check Select Full Join Count | SHOW GLOBAL STATUS LIKE 'Select_full_join'; | Monitors joins missing index keys. |
| 184 | Check Slow Queries Count | SHOW GLOBAL STATUS LIKE 'Slow_queries'; | Monitors total slow queries executed. |
| 185 | Check Com Select Count | SHOW GLOBAL STATUS LIKE 'Com_select'; | Monitors SELECT statements executed. |
| 186 | Check Com Insert Count | SHOW GLOBAL STATUS LIKE 'Com_insert'; | Monitors INSERT statements executed. |
| 187 | Check Com Update Count | SHOW GLOBAL STATUS LIKE 'Com_update'; | Monitors UPDATE statements executed. |
| 188 | Check Com Delete Count | SHOW GLOBAL STATUS LIKE 'Com_delete'; | Monitors DELETE statements executed. |
| 189 | Check Connections Count | SHOW GLOBAL STATUS LIKE 'Connections'; | Monitors total connection attempts since boot. |
| 190 | Check Aborted Connects | SHOW GLOBAL STATUS LIKE 'Aborted_connects'; | Monitors failed client connection attempts. |
| 191 | Check Aborted Clients | SHOW GLOBAL STATUS LIKE 'Aborted_clients'; | Monitors client connections dropped improperly. |
| 192 | Check Character Set System | SHOW VARIABLES LIKE 'character_set_system'; | Inspects system metadata character set (utf8mb3). |
| 193 | Check Character Set Server | SHOW VARIABLES LIKE 'character_set_server'; | Inspects default server character set. |
| 194 | Check Collation Server | SHOW VARIABLES LIKE 'collation_server'; | Inspects default server collation. |
| 195 | Check Time Zone Variable | SHOW VARIABLES LIKE 'time_zone'; | Inspects active server time zone. |
| 196 | Set Time Zone Session | SET time_zone = '+00:00'; | Configures active session time zone to UTC. |
| 197 | Check Default Storage Engine | SHOW VARIABLES LIKE 'default_storage_engine'; | Inspects default storage engine (InnoDB). |
| 198 | Check SQL Mode | SHOW VARIABLES LIKE 'sql_mode'; | Inspects active SQL syntax mode and strictness flags. |
| 199 | Set SQL Mode Strict | SET GLOBAL sql_mode = 'STRICT_TRANS_TABLES,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER'; | Enforces strict transaction safety mode. |
| 200 | Shutdown MariaDB Server SQL | SHUTDOWN; | Gracefully shuts down MariaDB server daemon. |
SQLite OLTP
Technical Architecture & Overview
SQLite is a C-language library that implements a self-contained, serverless, zero-configuration, transactional SQL database engine. It writes directly to a single disk file, featuring Write-Ahead Logging (WAL) concurrency, full-text search (FTS5), and R-Tree spatial extensions.
Primary Use Cases: Embedded systems, mobile applications (iOS/Android), desktop software, edge IoT devices, local application caching, and lightweight standalone testing environments.
Core Components: SQL Compiler, Virtual Machine (VDBE), B-Tree Manager, Page Cache, OS Interface (VFS), and WAL Journal File.
Exhaustive 200-command administrative, diagnostic, and operational matrix for SQLite.
| # | Operation / Action | CLI / PRAGMA Syntax | Description |
|---|---|---|---|
| 1 | Open Database CLI | sqlite3 enterprise.db | Launches interactive SQLite shell. |
| 2 | Backup Database File | sqlite3 enterprise.db ".backup 'backup.db'" | Creates a safe online database backup. |
| 3 | Restore Database | sqlite3 enterprise.db ".restore 'backup.db'" | Restores database from backup file. |
| 4 | Export SQL Dump | sqlite3 enterprise.db ".dump" > dump.sql | Exports schema and records to SQL. |
| 5 | Import SQL Dump | sqlite3 enterprise.db ".read dump.sql" | Imports SQL script into database. |
| 6 | List Tables | .tables | Outputs all database table names. |
| 7 | Show Table Schema | .schema users | Displays table creation DDL syntax. |
| 8 | Enable Header Display | .headers on | Displays column headers in CLI. |
| 9 | Set CSV Output Mode | .mode csv | Changes output format to comma-separated. |
| 10 | Export CSV File | .import --csv data.csv users | Bulk imports CSV file into table. |
| 11 | Analyze Database Stats | ANALYZE; | Gathers query planner statistics. |
| 12 | Vacuum Defragment | VACUUM; | Rebuilds database file to reclaim space. |
| 13 | Check Integrity | PRAGMA integrity_check; | Scans database file for corruption. |
| 14 | Set Journal Mode WAL | PRAGMA journal_mode = WAL; | Enables Write-Ahead Logging concurrency. |
| 15 | Check Journal Mode | PRAGMA journal_mode; | Inspects active journal mode. |
| 16 | Set Synchronous Mode | PRAGMA synchronous = NORMAL; | Configures disk write synchronization. |
| 17 | Check Page Size | PRAGMA page_size; | Inspects database page size in bytes. |
| 18 | Set Cache Size | PRAGMA cache_size = -64000; | Allocates 64MB memory page cache. |
| 19 | Explain Query Execution | EXPLAIN QUERY PLAN SELECT * FROM users WHERE id = 1; | Evaluates index search strategy. |
| 20 | Attach External Database | ATTACH DATABASE 'archive.db' AS archive; | Mounts secondary database file. |
| 21 | Detach External Database | DETACH DATABASE archive; | Unmounts external database file. |
| 22 | Create Index | CREATE INDEX idx_user_email ON users(email); | Provisions table index. |
| 23 | Drop Index | DROP INDEX idx_user_email; | Removes table index. |
| 24 | Enable Foreign Keys | PRAGMA foreign_keys = ON; | Enforces relational foreign key constraints. |
| 25 | Check Foreign Key Status | PRAGMA foreign_keys; | Inspects foreign key enforcement state. |
| 26 | List Indexes on Table | PRAGMA index_list('users'); | Outputs table index definitions. |
| 27 | List Table Columns | PRAGMA table_info('users'); | Inspects table column data types. |
| 28 | Check Database Size | SELECT page_count * page_size FROM pragma_page_count(), pragma_page_size(); | Calculates database file disk size. |
| 29 | Set Busy Timeout | PRAGMA busy_timeout = 5000; | Waits 5 seconds for locked database locks. |
| 30 | Exit SQLite CLI | .exit | Closes interactive shell. |
| 31 | Quick Integrity Check | PRAGMA quick_check; | Fast integrity scan omitting index validation. |
| 32 | Check Foreign Key Violations | PRAGMA foreign_key_check; | Scans database tables for broken FK references. |
| 33 | Set Auto Vacuum | PRAGMA auto_vacuum = FULL; | Enforces automatic database page reclamation. |
| 34 | Check Auto Vacuum Mode | PRAGMA auto_vacuum; | Inspects active auto-vacuum setting. |
| 35 | Incremental Vacuum | PRAGMA incremental_vacuum(100); | Reclaims up to 100 free pages from database. |
| 36 | Set Mmap Size | PRAGMA mmap_size = 268435456; | Allocates 256MB memory-mapped I/O limit. |
| 37 | Check Mmap Size | PRAGMA mmap_size; | Inspects memory-mapped I/O limit. |
| 38 | Set Locking Mode | PRAGMA locking_mode = EXCLUSIVE; | Enforces exclusive file locking for performance. |
| 39 | Reset Locking Mode | PRAGMA locking_mode = NORMAL; | Restores shared file locking. |
| 40 | Set Temp Store in Memory | PRAGMA temp_store = MEMORY; | Forces temporary tables and indexes into RAM. |
| 41 | Check Temp Store Setting | PRAGMA temp_store; | Inspects location setting for temp objects. |
| 42 | Set WAL Checkpoint | PRAGMA wal_checkpoint(TRUNCATE); | Flushes WAL file and truncates it to 0 bytes. |
| 43 | Check User Version | PRAGMA user_version; | Inspects application-defined schema version integer. |
| 44 | Set User Version | PRAGMA user_version = 5; | Sets application schema version integer. |
| 45 | Check Application ID | PRAGMA application_id; | Inspects application identifier integer. |
| 46 | Set Application ID | PRAGMA application_id = 123456; | Sets application identifier integer. |
| 47 | Check Compile Options | PRAGMA compile_options; | Lists compiler flags used to build SQLite binary. |
| 48 | Check Database Encoding | PRAGMA encoding; | Outputs database text encoding (UTF-8, UTF-16). |
| 49 | Check Hard Heap Limit | PRAGMA soft_heap_limit = 104857600; | Sets 100MB soft memory heap limit. |
| 50 | Check Freed List Count | PRAGMA freelist_count; | Displays number of unused free pages in DB file. |
| 51 | Check Max Page Count | PRAGMA max_page_count; | Inspects maximum allowed pages in database file. |
| 52 | Set Max Page Count | PRAGMA max_page_count = 1000000; | Limits maximum database file size. |
| 53 | Check Schema Version | PRAGMA schema_version; | Inspects internal schema modification counter. |
| 54 | Check Secure Delete | PRAGMA secure_delete = ON; | Overwrites deleted content with zeroes. |
| 55 | Set Threads Count | PRAGMA threads = 4; | Enables multi-threaded sorting and helper tasks. |
| 56 | Set Column Output Mode | .mode column | Formats CLI output into aligned text columns. |
| 57 | Set JSON Output Mode | .mode json | Formats CLI query results as JSON array. |
| 58 | Set HTML Output Mode | .mode html | Formats CLI query results as HTML table tags. |
| 59 | Set List Output Mode | .mode list | Formats CLI query results as pipe-separated list. |
| 60 | Set Markdown Output Mode | .mode markdown | Formats CLI query results as Markdown table. |
| 61 | Set Output File | .output output.txt | Redirects CLI query results to text file. |
| 62 | Restore Output Screen | .output stdout | Restores CLI query results to screen stdout. |
| 63 | Show Active Databases | .databases | Lists primary, temp, and attached database files. |
| 64 | Show CLI Prompt Setting | .prompt 'sqlite> ' ' ...> ' | Customizes interactive shell prompt strings. |
| 65 | Show CLI Timeout | .timeout 10000 | Sets CLI lock wait timeout to 10 seconds. |
| 66 | Check Table Count | SELECT COUNT(*) FROM sqlite_master WHERE type='table'; | Calculates total table count in schema. |
| 67 | List Table Indexes via Master | SELECT name FROM sqlite_master WHERE type='index' AND tbl_name='users'; | Queries system catalog for table indexes. |
| 68 | List Triggers via Master | SELECT name FROM sqlite_master WHERE type='trigger'; | Lists all triggers in database. |
| 69 | List Views via Master | SELECT name FROM sqlite_master WHERE type='view'; | Lists all views in database. |
| 70 | Create View | CREATE VIEW v_active_users AS SELECT * FROM users WHERE active = 1; | Provisions virtual table view. |
| 71 | Drop View | DROP VIEW IF EXISTS v_active_users; | Deletes virtual table view. |
| 72 | Create Trigger | CREATE TRIGGER trg_user_bu BEFORE UPDATE ON users BEGIN SELECT RAISE(FAIL, 'Updates forbidden'); END; | Provisions pre-update validation trigger. |
| 73 | Drop Trigger | DROP TRIGGER IF EXISTS trg_user_bu; | Deletes trigger routine. |
| 74 | Create Unique Index | CREATE UNIQUE INDEX idx_uniq_email ON users(email); | Enforces unique constraint via index. |
| 75 | Create Partial Index | CREATE INDEX idx_active ON users(created_at) WHERE active = 1; | Provisions index on subset of rows. |
| 76 | Create Virtual Table FTS5 | CREATE VIRTUAL TABLE docs_fts USING fts5(title, body); | Provisions full-text search 5 table. |
| 77 | Insert FTS5 Record | INSERT INTO docs_fts (title, body) VALUES ('Doc 1', 'Database architecture guide'); | Writes text record into FTS5 index. |
| 78 | Query FTS5 Fulltext Search | SELECT * FROM docs_fts WHERE docs_fts MATCH 'architecture'; | Executes high-speed full-text search. |
| 79 | Optimize FTS5 Index | INSERT INTO docs_fts(docs_fts) VALUES('optimize'); | Compacts FTS5 index storage structures. |
| 80 | Create Virtual Table RTree | CREATE VIRTUAL TABLE geo_index USING rtree(id, minX, maxX, minY, maxY); | Provisions spatial R-Tree index table. |
| 81 | Insert Spatial Box RTree | INSERT INTO geo_index VALUES (1, -73.9, -73.8, 40.7, 40.8); | Writes bounding box into RTree index. |
| 82 | Query Spatial Bounding Box | SELECT id FROM geo_index WHERE minX >= -74.0 AND maxX <= -73.0; | Executes spatial bounding box search. |
| 83 | Reindex All Tables | REINDEX; | Rebuilds all indexes across all attached databases. |
| 84 | Reindex Specific Table | REINDEX users; | Rebuilds all indexes for specific table. |
| 85 | Reindex Specific Index | REINDEX idx_user_email; | Rebuilds a single index file. |
| 86 | Check DB Page Count | PRAGMA page_count; | Inspects total pages allocated in DB file. |
| 87 | Check DB Free List | PRAGMA freelist_count; | Inspects free pages available for reuse. |
| 88 | Check Table Column Defaults | SELECT dflt_value FROM pragma_table_info('users') WHERE name='status'; | Inspects default column value. |
| 89 | Check Table Primary Key | SELECT name FROM pragma_table_info('users') WHERE pk > 0; | Identifies primary key columns. |
| 90 | Check Foreign Key List | PRAGMA foreign_key_list('orders'); | Inspects target tables and referenced columns. |
| 91 | Check Index Info Details | PRAGMA index_info('idx_user_email'); | Inspects indexed columns and sort order. |
| 92 | Check Index XInfo Details | PRAGMA index_xinfo('idx_user_email'); | Inspects extended index properties. |
| 93 | Savepoint Transaction | SAVEPOINT sp1; | Provisions transaction savepoint. |
| 94 | Release Savepoint | RELEASE SAVEPOINT sp1; | Commits transaction savepoint. |
| 95 | Rollback to Savepoint | ROLLBACK TO SAVEPOINT sp1; | Reverts transaction state to savepoint. |
| 96 | Begin Immediate Transaction | BEGIN IMMEDIATE TRANSACTION; | Acquires reserved lock before writes. |
| 97 | Begin Exclusive Transaction | BEGIN EXCLUSIVE TRANSACTION; | Acquires exclusive write lock on DB file. |
| 98 | Commit Transaction | COMMIT; | Finalizes active transaction. |
| 99 | Rollback Transaction | ROLLBACK; | Aborts active transaction. |
| 100 | Exit Shell Quietly | .quit | Exits command-line tool. |
| 101 | Quick Integrity Check | PRAGMA quick_check; | Fast integrity scan omitting index validation. |
| 102 | Check Foreign Key Violations | PRAGMA foreign_key_check; | Scans database tables for broken FK references. |
| 103 | Set Auto Vacuum | PRAGMA auto_vacuum = FULL; | Enforces automatic database page reclamation. |
| 104 | Incremental Vacuum | PRAGMA incremental_vacuum(100); | Reclaims up to 100 free pages from database. |
| 105 | Set Mmap Size | PRAGMA mmap_size = 268435456; | Allocates 256MB memory-mapped I/O limit. |
| 106 | Set Locking Mode Exclusive | PRAGMA locking_mode = EXCLUSIVE; | Enforces exclusive file locking for performance. |
| 107 | Set Temp Store Memory | PRAGMA temp_store = MEMORY; | Forces temporary tables and indexes into RAM. |
| 108 | WAL Checkpoint Truncate | PRAGMA wal_checkpoint(TRUNCATE); | Flushes WAL file and truncates it to 0 bytes. |
| 109 | Check User Version | PRAGMA user_version; | Inspects application-defined schema version integer. |
| 110 | Set User Version | PRAGMA user_version = 5; | Sets application schema version integer. |
| 111 | Check Database Encoding | PRAGMA encoding; | Outputs database text encoding (UTF-8, UTF-16). |
| 112 | Set Threads Count | PRAGMA threads = 4; | Enables multi-threaded sorting and helper tasks. |
| 113 | Set Output Mode JSON | .mode json | Formats CLI query results as JSON array. |
| 114 | Set Output Mode Column | .mode column | Formats CLI query results as aligned columns. |
| 115 | Show Active Databases | .databases | Lists primary, temp, and attached database files. |
| 116 | Check Table Count | SELECT COUNT(*) FROM sqlite_master WHERE type='table'; | Calculates total table count in schema. |
| 117 | Create View | CREATE VIEW v_active_users AS SELECT * FROM users WHERE active = 1; | Provisions virtual table view. |
| 118 | Drop View | DROP VIEW IF EXISTS v_active_users; | Deletes virtual table view. |
| 119 | Create FTS5 Table | CREATE VIRTUAL TABLE docs_fts USING fts5(title, body); | Provisions full-text search 5 table. |
| 120 | Insert FTS5 Record | INSERT INTO docs_fts (title, body) VALUES ('Doc 1', 'Database architecture guide'); | Writes text record into FTS5 index. |
| 121 | Query FTS5 Search | SELECT * FROM docs_fts WHERE docs_fts MATCH 'architecture'; | Executes high-speed full-text search. |
| 122 | Optimize FTS5 Index | INSERT INTO docs_fts(docs_fts) VALUES('optimize'); | Compacts FTS5 index storage structures. |
| 123 | Create RTree Spatial Table | CREATE VIRTUAL TABLE geo_index USING rtree(id, minX, maxX, minY, maxY); | Provisions spatial R-Tree index table. |
| 124 | Reindex All Tables | REINDEX; | Rebuilds all indexes across all attached databases. |
| 125 | Check DB Page Count | PRAGMA page_count; | Inspects total pages allocated in DB file. |
| 126 | Check DB Free List | PRAGMA freelist_count; | Inspects free pages available for reuse. |
| 127 | Begin Immediate Transaction | BEGIN IMMEDIATE TRANSACTION; | Acquires reserved lock before writes. |
| 128 | Begin Exclusive Transaction | BEGIN EXCLUSIVE TRANSACTION; | Acquires exclusive write lock on DB file. |
| 129 | Commit Transaction | COMMIT; | Finalizes active transaction. |
| 130 | Exit Shell Quietly | .quit | Exits command-line tool. |
| 131 | Check Database Page Count | PRAGMA page_count; | Inspects total allocated pages in DB file. |
| 132 | Check Database Free Page Count | PRAGMA freelist_count; | Inspects unallocated free pages available for reuse. |
| 133 | Check Database Page Size | PRAGMA page_size; | Inspects page size in bytes (default 4096). |
| 134 | Set Database Page Size | PRAGMA page_size = 8192; | Configures 8KB page size for new database files. |
| 135 | Check Database Cache Size | PRAGMA cache_size; | Inspects active page cache memory limit. |
| 136 | Set Database Cache Size KB | PRAGMA cache_size = -128000; | Allocates 128MB RAM for page cache. |
| 137 | Check Database Max Page Count | PRAGMA max_page_count; | Inspects maximum allowed pages in database file. |
| 138 | Set Database Max Page Count | PRAGMA max_page_count = 2000000; | Caps database file size to ~8GB. |
| 139 | Check Database Busy Timeout | PRAGMA busy_timeout; | Inspects lock wait timeout in milliseconds. |
| 140 | Set Database Busy Timeout | PRAGMA busy_timeout = 10000; | Sets 10-second lock wait timeout before throwing SQLITE_BUSY. |
| 141 | Check Database Synchronous Setting | PRAGMA synchronous; | Inspects disk write sync mode (0=OFF, 1=NORMAL, 2=FULL, 3=EXTRA). |
| 142 | Set Database Synchronous Off | PRAGMA synchronous = OFF; | Disables disk sync for maximum write speed in temp DBs. |
| 143 | Set Database Synchronous Full | PRAGMA synchronous = FULL; | Enforces full disk sync for maximum crash durability. |
| 144 | Check Database Journal Mode | PRAGMA journal_mode; | Inspects active journal mode (DELETE, TRUNCATE, PERSIST, MEMORY, WAL, OFF). |
| 145 | Set Database Journal Mode Delete | PRAGMA journal_mode = DELETE; | Restores traditional rollback journal mode. |
| 146 | Set Database Journal Mode Memory | PRAGMA journal_mode = MEMORY; | Stores rollback journal in RAM. |
| 147 | Check Database WAL Auto Checkpoint | PRAGMA wal_autocheckpoint; | Inspects WAL auto-checkpoint page threshold (default 1000). |
| 148 | Set Database WAL Auto Checkpoint | PRAGMA wal_autocheckpoint = 5000; | Sets auto-checkpoint trigger to 5000 pages. |
| 149 | Check Database Lock Status | PRAGMA lock_status; | Inspects active read/write file locks held. |
| 150 | Check Database Temp Store | PRAGMA temp_store; | Inspects storage location for temp tables (0=DEFAULT, 1=FILE, 2=MEMORY). |
| 151 | Set Database Temp Store File | PRAGMA temp_store = FILE; | Forces temp tables into disk files. |
| 152 | Check Database Foreign Keys | PRAGMA foreign_keys; | Inspects foreign key enforcement setting. |
| 153 | Disable Database Foreign Keys | PRAGMA foreign_keys = OFF; | Disables foreign key constraint checks during bulk loads. |
| 154 | Check Database Recursive Triggers | PRAGMA recursive_triggers; | Inspects recursive trigger execution setting. |
| 155 | Enable Database Recursive Triggers | PRAGMA recursive_triggers = ON; | Allows triggers to fire recursively. |
| 156 | Check Database Secure Delete | PRAGMA secure_delete; | Inspects whether deleted pages are zero-overwritten. |
| 157 | Disable Database Secure Delete | PRAGMA secure_delete = OFF; | Disables zero-overwrite on deleted pages for speed. |
| 158 | Check Database Mmap Size | PRAGMA mmap_size; | Inspects memory-mapped I/O byte limit. |
| 159 | Set Database Mmap Size 1GB | PRAGMA mmap_size = 1073741824; | Allocates 1GB memory-mapped I/O limit. |
| 160 | Check Database Threads | PRAGMA threads; | Inspects helper thread pool limit. |
| 161 | Check Database User Version | PRAGMA user_version; | Inspects user schema version integer. |
| 162 | Check Database Application ID | PRAGMA application_id; | Inspects application ID integer. |
| 163 | Check Database Schema Version | PRAGMA schema_version; | Inspects internal schema modification sequence. |
| 164 | Check Database Encoding | PRAGMA encoding; | Outputs text encoding (UTF-8, UTF-16le, UTF-16be). |
| 165 | Check Database Compile Options | PRAGMA compile_options; | Outputs list of C compiler flags used to build SQLite. |
| 166 | Check Database Soft Heap Limit | PRAGMA soft_heap_limit; | Inspects soft memory heap limit in bytes. |
| 167 | Set Database Soft Heap Limit | PRAGMA soft_heap_limit = 2147483648; | Sets 2GB soft memory heap limit. |
| 168 | Check Table Column Info | PRAGMA table_info('users'); | Outputs column names, types, nullability, and primary key status. |
| 169 | Check Table Extended Column Info | PRAGMA table_xinfo('users'); | Outputs column details including generated columns. |
| 170 | Check Table Index List | PRAGMA index_list('users'); | Lists all secondary and primary indexes on table. |
| 171 | Check Index Column Details | PRAGMA index_info('idx_users_email'); | Lists columns included in specific index. |
| 172 | Check Index Extended Details | PRAGMA index_xinfo('idx_users_email'); | Lists key and non-key columns in index. |
| 173 | Check Foreign Key References | PRAGMA foreign_key_list('orders'); | Lists foreign key target tables and columns. |
| 174 | Check Database Integrity Full | PRAGMA integrity_check; | Scans entire database file for structural corruption. |
| 175 | Check Database Integrity Quick | PRAGMA quick_check; | Scans database file omitting index leaf validation. |
| 176 | Check Database Foreign Key Violations | PRAGMA foreign_key_check; | Scans entire database for broken foreign key references. |
| 177 | Check Table Foreign Key Violations | PRAGMA foreign_key_check('orders'); | Scans specific table for broken foreign key references. |
| 178 | Checkpoint WAL Passive | PRAGMA wal_checkpoint(PASSIVE); | Checkpoints WAL pages without blocking active readers/writers. |
| 179 | Checkpoint WAL Full | PRAGMA wal_checkpoint(FULL); | Checkpoints all WAL pages waiting for readers to finish. |
| 180 | Checkpoint WAL Restart | PRAGMA wal_checkpoint(RESTART); | Flushes WAL and blocks new readers to restart WAL at byte 0. |
| 181 | Checkpoint WAL Truncate | PRAGMA wal_checkpoint(TRUNCATE); | Flushes WAL, blocks readers, and truncates file to 0 bytes. |
| 182 | Set CLI Mode Table | .mode table | Formats CLI query output as ASCII box table. |
| 183 | Set CLI Mode Box | .mode box | Formats CLI query output as Unicode box table. |
| 184 | Set CLI Mode CSV | .mode csv | Formats CLI query output as comma-separated values. |
| 185 | Set CLI Mode JSON | .mode json | Formats CLI query output as JSON array. |
| 186 | Set CLI Mode Line | .mode line | Formats CLI query output as key-value lines. |
| 187 | Set CLI Mode List | .mode list | Formats CLI query output as pipe-separated list. |
| 188 | Set CLI Mode Markdown | .mode markdown | Formats CLI query output as Markdown table. |
| 189 | Set CLI Mode HTML | .mode html | Formats CLI query output as HTML table tags. |
| 190 | Set CLI Output File | .output results.txt | Redirects query results output to text file. |
| 191 | Restore CLI Output Screen | .output stdout | Restores query results output to terminal screen. |
| 192 | Show CLI Tables List | .tables | Lists all tables in connected databases. |
| 193 | Show CLI Schema DDL | .schema | Outputs full DDL schema for all tables and indexes. |
| 194 | Show Table DDL | .schema users | Outputs DDL syntax for specific table. |
| 195 | Show Active Database Files | .databases | Lists primary, temp, and attached database files. |
| 196 | Show CLI Headers On | .headers on | Enables column headers in query output. |
| 197 | Show CLI Headers Off | .headers off | Disables column headers in query output. |
| 198 | Check SQLite Version SQL | SELECT sqlite_version(); | Outputs running SQLite engine release version string. |
| 199 | Check SQLite Source ID SQL | SELECT sqlite_source_id(); | Outputs exact git commit hash used to build SQLite. |
| 200 | Check Connection Ping SQL | SELECT 1; | Simple connection ping test returning 1. |
CockroachDB OLTP
Technical Architecture & Overview
CockroachDB is a cloud-native, distributed SQL database designed for global scalability and strong consistency. It uses a transactional key-value store layered under a distributed SQL query engine, leveraging the Raft consensus algorithm for Multi-Raft data replication and Range splitting.
Primary Use Cases: Multi-region cloud applications, global SaaS platforms, distributed financial ledgers, and scale-out transactional services requiring serializable isolation.
Core Components: SQL Layer, Distributed KV Layer, Raft Consensus Protocol, Storage Layer (Pebble engine), Range Allocator, and System Jobs Manager.
Exhaustive 200-command administrative, diagnostic, and operational matrix for CockroachDB.
| # | Operation / Action | CLI / SQL Syntax | Description |
|---|---|---|---|
| 1 | Start Node Server | cockroach start --insecure --store=node1 --listen-addr=localhost:26257 | Boots distributed database node. |
| 2 | Initialize Cluster | cockroach init --insecure --host=localhost:26257 | Bootstraps new distributed cluster. |
| 3 | Interactive SQL Shell | cockroach sql --insecure --host=localhost:26257 | Opens distributed SQL monitor. |
| 4 | Export Cluster Backup | BACKUP INTO 's3://my-bucket/backup' AS OF SYSTEM TIME '-1m'; | Takes distributed cluster snapshot. |
| 5 | Restore Cluster Backup | RESTORE FROM 's3://my-bucket/backup'; | Restores distributed database snapshot. |
| 6 | Check Node Status | SHOW CONSTRAINTS; SELECT * FROM crdb_internal.gossip_nodes; | Inspects active cluster nodes. |
| 7 | Check Range Replication | SHOW RANGES FROM TABLE users; | Inspects distributed data raft ranges. |
| 8 | Create Database | CREATE DATABASE enterprise_db; | Provisions new distributed database. |
| 9 | Drop Database | DROP DATABASE enterprise_db; | Deletes distributed database. |
| 10 | Create User | CREATE USER app_user WITH PASSWORD 'SecurePass!'; | Provisions cluster user login. |
| 11 | Grant Privileges | GRANT ALL ON DATABASE enterprise_db TO app_user; | Assigns distributed data access. |
| 12 | Explain Query Execution | EXPLAIN ANALYZE SELECT * FROM users WHERE id = 5; | Evaluates distributed execution plan. |
| 13 | Check Table Stats | SHOW STATISTICS FOR TABLE users; | Inspects cost-based optimizer statistics. |
| 14 | Create Index | CREATE INDEX idx_user_email ON users(email); | Provisions distributed table index. |
| 15 | Drop Index | DROP INDEX users@idx_user_email; | Removes distributed index. |
| 16 | Set Zone Configuration | ALTER RANGE default CONFIGURE ZONE USING num_replicas = 5; | Configures data replication zones. |
| 17 | View Zone Configs | SHOW ZONE CONFIGURATION FOR DATABASE enterprise_db; | Inspects replication zone rules. |
| 18 | Check Cluster Metrics | SELECT * FROM crdb_internal.node_metrics WHERE metric LIKE 'sql.query%'; | Pulls cluster telemetry metrics. |
| 19 | Decommission Node | cockroach node decommission 2 --insecure | Safely removes node from cluster. |
| 20 | Inspect Node Liveness | SELECT * FROM crdb_internal.liveness; | Checks node heartbeat status. |
| 21 | Pause Job Execution | CANCEL JOB 8492038420; | Stops background schema change job. |
| 22 | List Running Jobs | SHOW JOBS; | Inspects asynchronous cluster jobs. |
| 23 | Set Session Setting | SET application_name = 'EnterpriseBatch'; | Configures connection metadata. |
| 24 | Create Schema | CREATE SCHEMA staging; | Provisions logical database namespace. |
| 25 | Set Default TTL | ALTER TABLE logs SET (ttl_expire_after = '90 days'); | Enables automatic data expiration. |
| 26 | Inspect KV Storage Size | SELECT sum(range_size) FROM crdb_internal.ranges; | Calculates physical cluster storage size. |
| 27 | Verify Cluster Version | SHOW CLUSTER SETTING version; | Inspects running software version. |
| 28 | Set Cluster Setting | SET CLUSTER SETTING kv.rangefeed.enabled = true; | Modifies global cluster parameter. |
| 29 | Trace Query Execution | EXPLAIN DISTSQL SELECT * FROM users; | Inspects distributed query flow. |
| 30 | Quit SQL Shell | \q | Closes interactive shell session. |
| 31 | Check Active Sessions | SHOW SESSIONS; | Inspects connected client session threads. |
| 32 | Check Active Queries | SHOW STATEMENTS; | Views currently executing SQL queries. |
| 33 | Cancel Session | CANCEL SESSION '16834abc'; | Terminates active client connection session. |
| 34 | Cancel Statement | CANCEL STATEMENT '16834abc'; | Terminates specific running SQL query. |
| 35 | Pause Job | PAUSE JOB 8492038420; | Temporarily halts execution of background job. |
| 36 | Resume Job | RESUME JOB 8492038420; | Resumes execution of paused background job. |
| 37 | Show Job Details | SHOW JOB 8492038420; | Inspects progress and error details of background job. |
| 38 | Create Inverted Index | CREATE INVERTED INDEX idx_payload ON logs(payload); | Provisions GIN-like index for JSONB columns. |
| 39 | Create Stored Procedure | CREATE PROCEDURE clean_data() AS $$ BEGIN DELETE FROM logs WHERE created_at < NOW() - INTERVAL '30 days'; END; $$ LANGUAGE PLpgSQL; | Provisions stored procedure routine. |
| 40 | Call Stored Procedure | CALL clean_data(); | Executes stored procedure routine. |
| 41 | Drop Stored Procedure | DROP PROCEDURE clean_data; | Deletes stored procedure routine. |
| 42 | Create User Defined Function | CREATE FUNCTION add_tax(p DECIMAL) RETURNS DECIMAL AS $$ SELECT p * 1.08; $$ LANGUAGE SQL; | Provisions scalar user function. |
| 43 | Drop User Defined Function | DROP FUNCTION add_tax; | Deletes user defined function. |
| 44 | Create Changefeed (CDC) | CREATE CHANGEFEED FOR TABLE users INTO 'kafka://localhost:9092'; | Streams CDC row mutations to Kafka. |
| 45 | Create Changefeed with Filter | CREATE CHANGEFEED FOR TABLE users WHERE email LIKE '%@org.com' INTO 'kafka://localhost:9092'; | Streams filtered CDC events. |
| 46 | Show Changefeeds | SHOW CHANGEFEEDS; | Lists active CDC changefeed pipelines. |
| 47 | Cancel Changefeed | CANCEL JOB (SELECT job_id FROM [SHOW CHANGEFEEDS] WHERE topic = 'users'); | Stops running CDC changefeed. |
| 48 | Create Regional Table | ALTER TABLE users SET LOCALITY REGIONAL BY TABLE IN "us-east1"; | Binds table storage to specific cloud region. |
| 49 | Create Global Table | ALTER TABLE reference_data SET LOCALITY GLOBAL; | Optimizes table for fast low-latency reads worldwide. |
| 50 | Create Regional Row Table | ALTER TABLE users SET LOCALITY REGIONAL BY ROW AS region; | Binds individual rows to cloud region. |
| 51 | Show Table Locality | SHOW LOCALITY FROM TABLE users; | Inspects multi-region locality configuration. |
| 52 | Add Region to Database | ALTER DATABASE enterprise_db ADD REGION "us-west1"; | Expands database multi-region footprint. |
| 53 | Drop Region from Database | ALTER DATABASE enterprise_db DROP REGION "us-west1"; | Removes cloud region from database. |
| 54 | Set Primary Region | ALTER DATABASE enterprise_db SET PRIMARY REGION "us-east1"; | Designates primary region for database metadata. |
| 55 | Show Database Regions | SHOW REGIONS FROM DATABASE enterprise_db; | Lists cloud regions assigned to database. |
| 56 | Check Range Leases | SELECT * FROM crdb_internal.range_leases; | Inspects active Raft leaseholders per range. |
| 57 | Check Range Replicas | SELECT * FROM crdb_internal.kv_node_status; | Inspects KV node status and Raft replica count. |
| 58 | Check Range Splitting | ALTER TABLE users CONFIGURE ZONE USING range_max_bytes = 67108864; | Configures 64MB max Range split size. |
| 59 | Split Range Manually | ALTER TABLE users SPLIT AT VALUES (100000); | Manually forces range split at key boundary. |
| 60 | Unsplit Range Manually | ALTER TABLE users UNSPLIT AT VALUES (100000); | Removes manual range split boundary. |
| 61 | Check Cluster Settings | SHOW ALL CLUSTER SETTINGS; | Lists all configurable cluster parameters. |
| 62 | Reset Cluster Setting | RESET CLUSTER SETTING kv.rangefeed.enabled; | Restores cluster setting to default value. |
| 63 | Check Table Locks | SELECT * FROM crdb_internal.locks; | Inspects lock contention across KV keys. |
| 64 | Check Contention Events | SELECT * FROM crdb_internal.transaction_contention_events; | Analyzes transaction retry bottlenecks. |
| 65 | Set Transaction Isolation | SET TRANSACTION ISOLATION LEVEL SERIALIZABLE; | Enforces strict serializable isolation. |
| 66 | Set Transaction Priority | SET TRANSACTION PRIORITY HIGH; | Increases transaction priority to reduce retries. |
| 67 | Show Table Schema DDL | SHOW CREATE TABLE users; | Outputs exact DDL syntax used to build table. |
| 68 | Show Database Schema DDL | SHOW CREATE DATABASE enterprise_db; | Outputs exact DDL syntax used to build DB. |
| 69 | Check Indexes on Table | SHOW INDEXES FROM users; | Lists all primary and secondary index keys. |
| 70 | Create Partial Index | CREATE INDEX idx_active_users ON users(created_at) WHERE active = true; | Provisions filtered index for active rows. |
| 71 | Create Covering Index | CREATE INDEX idx_email_name ON users(email) STORING (name); | Includes non-key columns in index storage. |
| 72 | Create Hash Partitioned Index | CREATE INDEX idx_id_hash ON users(id) USING HASH; | Distributes index traffic across ranges. |
| 73 | Check Disk Usage per Table | SELECT table_name, pg_size_pretty(total_bytes) FROM crdb_internal.table_sizes; | Calculates disk usage per table. |
| 74 | Check Disk Usage per Node | SELECT node_id, pg_size_pretty(available_bytes) FROM crdb_internal.kv_node_status; | Calculates disk space per node. |
| 75 | Create Role | CREATE ROLE read_only_role; | Provisions access role container. |
| 76 | Grant Role to User | GRANT read_only_role TO app_user; | Assigns role permissions to user. |
| 77 | Revoke Role from User | REVOKE read_only_role FROM app_user; | Revokes role permissions from user. |
| 78 | Drop Role | DROP ROLE read_only_role; | Deletes role container. |
| 79 | Grant Schema Usage | GRANT USAGE ON SCHEMA staging TO app_user; | Grants namespace access rights. |
| 80 | Revoke Schema Usage | REVOKE USAGE ON SCHEMA staging FROM app_user; | Revokes namespace access rights. |
| 81 | Show Grants for User | SHOW GRANTS FOR app_user; | Lists all privileges assigned to user. |
| 82 | Set Password Expiry | ALTER USER app_user WITH PASSWORD 'Pass123!' VALID UNTIL '2027-01-01'; | Sets login expiration date. |
| 83 | Check System Jobs History | SELECT * FROM crdb_internal.jobs WHERE job_type = 'BACKUP'; | Inspects backup job history log. |
| 84 | Check Node Hardware Specs | SELECT * FROM crdb_internal.node_hardware; | Inspects CPU cores and RAM per node. |
| 85 | Check Hot Ranges | SELECT * FROM crdb_internal.hot_ranges; | Identifies ranges receiving high QPS traffic. |
| 86 | Check Table Column Types | SHOW COLUMNS FROM users; | Inspects table column definitions. |
| 87 | Rename Table | ALTER TABLE users RENAME TO app_users; | Renames table relation in database. |
| 88 | Rename Column | ALTER TABLE users RENAME COLUMN email TO user_email; | Renames table column. |
| 89 | Add Column Default | ALTER TABLE users ALTER COLUMN status SET DEFAULT 'active'; | Sets default value for column. |
| 90 | Drop Column Default | ALTER TABLE users ALTER COLUMN status DROP DEFAULT; | Removes default value from column. |
| 91 | Set Column Type | ALTER TABLE users ALTER COLUMN age SET DATA TYPE INT8; | Changes column data type definition. |
| 92 | Create Savepoint | SAVEPOINT cockroach_restart; | Provisions savepoint for application retries. |
| 93 | Release Savepoint | RELEASE SAVEPOINT cockroach_restart; | Finalizes transaction retry savepoint. |
| 94 | Rollback Savepoint | ROLLBACK TO SAVEPOINT cockroach_restart; | Retries transaction after conflict. |
| 95 | Check Cluster License | SHOW CLUSTER SETTING enterprise.license; | Inspects enterprise license key status. |
| 96 | Set Enterprise License | SET CLUSTER SETTING enterprise.license = 'ccl_key_xyz'; | Applies enterprise feature key. |
| 97 | Check Cluster CPU Telemetry | SELECT * FROM crdb_internal.node_metrics WHERE metric LIKE 'sys.cpu%'; | Inspects CPU load across cluster. |
| 98 | Check Cluster Memory Telemetry | SELECT * FROM crdb_internal.node_metrics WHERE metric LIKE 'sys.rss%'; | Inspects RAM usage across cluster. |
| 99 | Flush Table Stats | ANALYZE users; | Triggers on-demand optimizer statistics collection. |
| 100 | Node Health Check HTTP | curl http://localhost:8080/health | Queries HTTP diagnostic endpoint for node status. |
| 101 | Check Active Sessions | SHOW SESSIONS; | Inspects connected client session threads. |
| 102 | Check Active Statements | SHOW STATEMENTS; | Views currently executing SQL queries. |
| 103 | Cancel Statement | CANCEL STATEMENT '16834abc'; | Terminates specific running SQL query. |
| 104 | Pause Background Job | PAUSE JOB 8492038420; | Temporarily halts execution of background job. |
| 105 | Resume Background Job | RESUME JOB 8492038420; | Resumes execution of paused background job. |
| 106 | Show Job Details | SHOW JOB 8492038420; | Inspects progress and error details of background job. |
| 107 | Create Inverted Index | CREATE INVERTED INDEX idx_payload ON logs(payload); | Provisions GIN-like index for JSONB columns. |
| 108 | Create Changefeed (CDC) | CREATE CHANGEFEED FOR TABLE users INTO 'kafka://localhost:9092'; | Streams CDC row mutations to Kafka. |
| 109 | Show Active Changefeeds | SHOW CHANGEFEEDS; | Lists active CDC changefeed pipelines. |
| 110 | Create Regional Table | ALTER TABLE users SET LOCALITY REGIONAL BY TABLE IN "us-east1"; | Binds table storage to specific cloud region. |
| 111 | Create Global Table | ALTER TABLE reference_data SET LOCALITY GLOBAL; | Optimizes table for fast low-latency reads worldwide. |
| 112 | Create Regional Row Table | ALTER TABLE users SET LOCALITY REGIONAL BY ROW AS region; | Binds individual rows to cloud region. |
| 113 | Show Table Locality | SHOW LOCALITY FROM TABLE users; | Inspects multi-region locality configuration. |
| 114 | Add Region to DB | ALTER DATABASE enterprise_db ADD REGION "us-west1"; | Expands database multi-region footprint. |
| 115 | Drop Region from DB | ALTER DATABASE enterprise_db DROP REGION "us-west1"; | Removes cloud region from database. |
| 116 | Set Primary Region | ALTER DATABASE enterprise_db SET PRIMARY REGION "us-east1"; | Designates primary region for database metadata. |
| 117 | Show Database Regions | SHOW REGIONS FROM DATABASE enterprise_db; | Lists cloud regions assigned to database. |
| 118 | Check Range Leases | SELECT * FROM crdb_internal.range_leases; | Inspects active Raft leaseholders per range. |
| 119 | Check Range Replicas | SELECT * FROM crdb_internal.kv_node_status; | Inspects KV node status and Raft replica count. |
| 120 | Split Range Manually | ALTER TABLE users SPLIT AT VALUES (100000); | Manually forces range split at key boundary. |
| 121 | Unsplit Range Manually | ALTER TABLE users UNSPLIT AT VALUES (100000); | Removes manual range split boundary. |
| 122 | Check Cluster Settings | SHOW ALL CLUSTER SETTINGS; | Lists all configurable cluster parameters. |
| 123 | Check Transaction Contention | SELECT * FROM crdb_internal.transaction_contention_events; | Analyzes transaction retry bottlenecks. |
| 124 | Set Isolation Level | SET TRANSACTION ISOLATION LEVEL SERIALIZABLE; | Enforces strict serializable isolation. |
| 125 | Show Create Table DDL | SHOW CREATE TABLE users; | Outputs exact DDL syntax used to build table. |
| 126 | Create Covering Index | CREATE INDEX idx_email_name ON users(email) STORING (name); | Includes non-key columns in index storage. |
| 127 | Check Disk Usage per Table | SELECT table_name, pg_size_pretty(total_bytes) FROM crdb_internal.table_sizes; | Calculates disk usage per table. |
| 128 | Check Disk Usage per Node | SELECT node_id, pg_size_pretty(available_bytes) FROM crdb_internal.kv_node_status; | Calculates disk space per node. |
| 129 | Check Hot Ranges | SELECT * FROM crdb_internal.hot_ranges; | Identifies ranges receiving high QPS traffic. |
| 130 | Check Node Health HTTP | curl http://localhost:8080/health | Queries HTTP diagnostic endpoint for node status. |
| 131 | Check Cluster ID | SELECT * FROM crdb_internal.cluster_id; | Outputs unique cluster GUID. |
| 132 | Check Cluster Nodes List | SELECT node_id, address, build_tag FROM crdb_internal.gossip_nodes; | Lists all active nodes in cluster gossip. |
| 133 | Check Node Network Liveness | SELECT node_id, is_live, updated_at FROM crdb_internal.liveness; | Monitors node heartbeat timestamps. |
| 134 | Check Range Count Total | SELECT count(*) FROM crdb_internal.ranges; | Calculates total Raft range count in cluster. |
| 135 | Check Range Size Metrics | SELECT min(range_size), avg(range_size), max(range_size) FROM crdb_internal.ranges; | Calculates min, avg, and max Raft range byte sizes. |
| 136 | Check Range Under Replicated Count | SELECT count(*) FROM crdb_internal.ranges WHERE array_length(replicas, 1) < 3; | Identifies under-replicated ranges. |
| 137 | Check Range Unavailable Count | SELECT count(*) FROM crdb_internal.ranges WHERE array_length(replicas, 1) = 0; | Identifies offline unavailable ranges. |
| 138 | Check Table Partition Ranges | SELECT * FROM crdb_internal.ranges WHERE table_name = 'users'; | Inspects Raft ranges belonging to specific table. |
| 139 | Check Raft Leader Distribution | SELECT lease_holder, count(*) FROM crdb_internal.ranges GROUP BY lease_holder; | Calculates Raft leaseholder distribution across nodes. |
| 140 | Check Table Column Metadata | SELECT column_name, data_type, is_nullable FROM information_schema.columns WHERE table_name = 'users'; | Inspects column definitions. |
| 141 | Check Table Primary Key Metadata | SELECT column_name FROM information_schema.key_column_usage WHERE table_name = 'users'; | Identifies primary key columns. |
| 142 | Check Table Foreign Key Metadata | SELECT * FROM information_schema.referential_constraints; | Lists foreign key relationships in database. |
| 143 | Check Table Indexes Metadata | SELECT index_name, column_name, direction FROM information_schema.statistics WHERE table_name = 'users'; | Lists indexed columns and sort directions. |
| 144 | Check Table Constraints List | SELECT constraint_name, constraint_type FROM information_schema.table_constraints WHERE table_name = 'users'; | Lists unique, check, and foreign key constraints. |
| 145 | Check System Jobs Running | SELECT job_id, description, status FROM crdb_internal.jobs WHERE status = 'running'; | Lists active background jobs. |
| 146 | Check System Jobs Failed | SELECT job_id, description, error FROM crdb_internal.jobs WHERE status = 'failed'; | Inspects failed background jobs and stack traces. |
| 147 | Check System Jobs Completed | SELECT job_id, description, created, finished FROM crdb_internal.jobs WHERE status = 'succeeded' ORDER BY finished DESC LIMIT 10; | Inspects recently completed jobs. |
| 148 | Check Active SQL Sessions | SELECT session_id, user_name, client_address, application_name FROM crdb_internal.node_sessions; | Lists active client sessions across all nodes. |
| 149 | Check Active SQL Queries | SELECT query_id, user_name, query, phase FROM crdb_internal.node_statement_statistics WHERE phase = 'executing'; | Lists active running SQL queries. |
| 150 | Check Slow SQL Queries | SELECT query, service_lat, exec_lat FROM crdb_internal.node_statement_statistics ORDER BY exec_lat DESC LIMIT 10; | Finds queries with highest execution latency. |
| 151 | Check SQL Memory Usage | SELECT node_id, value FROM crdb_internal.node_metrics WHERE metric = 'sql.mem.sql.current'; | Monitors RAM allocated to SQL query execution. |
| 152 | Check KV Memory Usage | SELECT node_id, value FROM crdb_internal.node_metrics WHERE metric = 'val.mem.pebble.current'; | Monitors RAM allocated to Pebble KV storage engine. |
| 153 | Check Go Runtime Memory Usage | SELECT node_id, value FROM crdb_internal.node_metrics WHERE metric = 'sys.rss'; | Monitors resident set size RAM per node. |
| 154 | Check Go Runtime Garbage Collection | SELECT node_id, value FROM crdb_internal.node_metrics WHERE metric = 'sys.gc.pause.ns'; | Monitors Go GC pause latency. |
| 155 | Check CPU User Percent | SELECT node_id, value FROM crdb_internal.node_metrics WHERE metric = 'sys.cpu.user.percent'; | Monitors user-space CPU utilization percentage. |
| 156 | Check CPU System Percent | SELECT node_id, value FROM crdb_internal.node_metrics WHERE metric = 'sys.cpu.sys.percent'; | Monitors kernel-space CPU utilization percentage. |
| 157 | Check Disk Free Bytes | SELECT node_id, value FROM crdb_internal.node_metrics WHERE metric = 'capacity.available'; | Monitors free storage disk space per node. |
| 158 | Check Disk Total Bytes | SELECT node_id, value FROM crdb_internal.node_metrics WHERE metric = 'capacity'; | Monitors total storage disk space per node. |
| 159 | Check Disk Used Bytes | SELECT node_id, value FROM crdb_internal.node_metrics WHERE metric = 'capacity.used'; | Monitors used storage disk space per node. |
| 160 | Check Network Bytes Sent | SELECT node_id, value FROM crdb_internal.node_metrics WHERE metric = 'exec.net.bytes-sent'; | Monitors inter-node network egress bytes. |
| 161 | Check Network Bytes Received | SELECT node_id, value FROM crdb_internal.node_metrics WHERE metric = 'exec.net.bytes-rcvd'; | Monitors inter-node network ingress bytes. |
| 162 | Check Raft Proposals Count | SELECT node_id, value FROM crdb_internal.node_metrics WHERE metric = 'raft.commands.applied'; | Monitors total Raft consensus state machine commits. |
| 163 | Check Raft Command Latency | SELECT node_id, value FROM crdb_internal.node_metrics WHERE metric = 'raft.process.logcommit.latency'; | Monitors Raft log write commit latency. |
| 164 | Check Storage Engine Pebble Compaction | SELECT node_id, value FROM crdb_internal.node_metrics WHERE metric = 'storage.compaction.count'; | Monitors background Pebble SSTable compactions. |
| 165 | Check Storage Engine Pebble Write Amplification | SELECT node_id, value FROM crdb_internal.node_metrics WHERE metric = 'storage.write-amp'; | Monitors Pebble storage write amplification ratio. |
| 166 | Check Session Application Name | SHOW application_name; | Outputs active connection application name. |
| 167 | Check Session Timezone | SHOW TIME ZONE; | Outputs active session time zone. |
| 168 | Set Session Timezone | SET TIME ZONE 'UTC'; | Sets active session time zone to UTC. |
| 169 | Check Session Transaction Isolation | SHOW TRANSACTION ISOLATION LEVEL; | Outputs active transaction isolation mode (SERIALIZABLE). |
| 170 | Check Current User Account | SELECT current_user(); | Returns active execution user name. |
| 171 | Check Current Database Name | SELECT current_database(); | Returns active selected database name. |
| 172 | Check Current Schema Name | SELECT current_schema(); | Returns active selected schema name. |
| 173 | Check Current Timestamp | SELECT clock_timestamp(); | Returns current wall-clock timestamp. |
| 174 | Check CockroachDB Version SQL | SELECT version(); | Outputs running CockroachDB build version and git commit hash. |
| 175 | Check Connection Ping SQL | SELECT 1; | Simple connection ping test returning 1. |
| 176 | Check Health Endpoint HTTP | curl http://localhost:8080/health | Queries HTTP REST endpoint for node health status. |
| 177 | Check Health Readiness HTTP | curl http://localhost:8080/health?ready=1 | Queries HTTP REST endpoint for node readiness probe. |
| 178 | Check Metrics Endpoint HTTP | curl http://localhost:8080/_status/vars | Pulls Prometheus metrics endpoint. |
| 179 | Check CLI Node Status | cockroach node status --insecure | Outputs status table for all nodes via CLI tool. |
| 180 | Check CLI Cluster Version | cockroach version | Outputs client CLI binary version string. |
| 181 | Check Table Column Default Values | SELECT column_name, column_default FROM information_schema.columns WHERE table_name = 'users'; | Inspects column default values. |
| 182 | Check Table Column Data Types | SELECT column_name, data_type FROM information_schema.columns WHERE table_name = 'users'; | Inspects column data types. |
| 183 | Check Table Column Nullability | SELECT column_name, is_nullable FROM information_schema.columns WHERE table_name = 'users'; | Inspects column nullability. |
| 184 | Check Table Primary Key Columns | SELECT column_name FROM information_schema.key_column_usage WHERE table_name = 'users'; | Inspects primary key columns. |
| 185 | Check Table Foreign Keys List | SELECT constraint_name FROM information_schema.table_constraints WHERE table_name = 'users' AND constraint_type = 'FOREIGN KEY'; | Lists foreign key constraints. |
| 186 | Check Table Unique Constraints List | SELECT constraint_name FROM information_schema.table_constraints WHERE table_name = 'users' AND constraint_type = 'UNIQUE'; | Lists unique constraints. |
| 187 | Check Table Check Constraints List | SELECT constraint_name FROM information_schema.table_constraints WHERE table_name = 'users' AND constraint_type = 'CHECK'; | Lists check constraints. |
| 188 | Check Table Indexes List | SELECT index_name FROM information_schema.statistics WHERE table_name = 'users'; | Lists indexes on table. |
| 189 | Check Table Storage Size Bytes | SELECT pg_relation_size('users'); | Calculates table storage size in bytes. |
| 190 | Check Database Size Bytes | SELECT pg_database_size('enterprise_db'); | Calculates database storage size in bytes. |
| 191 | Check Cluster Node Count | SELECT count(*) FROM crdb_internal.gossip_nodes; | Calculates total cluster node count. |
| 192 | Check Cluster Live Node Count | SELECT count(*) FROM crdb_internal.liveness WHERE is_live = true; | Calculates total live cluster node count. |
| 193 | Check Cluster Range Count | SELECT count(*) FROM crdb_internal.ranges; | Calculates total Raft range count. |
| 194 | Check Cluster Range Replicas Count | SELECT sum(array_length(replicas, 1)) FROM crdb_internal.ranges; | Calculates total Raft range replicas. |
| 195 | Check Cluster Job Count | SELECT count(*) FROM crdb_internal.jobs; | Calculates total background jobs count. |
| 196 | Check Cluster Job Running Count | SELECT count(*) FROM crdb_internal.jobs WHERE status = 'running'; | Calculates running jobs count. |
| 197 | Check Cluster Job Failed Count | SELECT count(*) FROM crdb_internal.jobs WHERE status = 'failed'; | Calculates failed jobs count. |
| 198 | Check Cluster Job Succeeded Count | SELECT count(*) FROM crdb_internal.jobs WHERE status = 'succeeded'; | Calculates succeeded jobs count. |
| 199 | Check Session User Name | SELECT current_user(); | Outputs current user name. |
| 200 | Check Session Database Name | SELECT current_database(); | Outputs current database name. |
PingCAP TiDB OLTP
Technical Architecture & Overview
PingCAP TiDB is a distributed Hybrid Transactional and Analytical Processing (HTAP) database. It decouples stateless SQL compute nodes (TiDB) from distributed row storage nodes (TiKV, using Multi-Raft) and columnar analytical storage nodes (TiFlash, using Raft learner synchronization), governed by a Placement Driver (PD) cluster.
Primary Use Cases: Large-scale real-time HTAP workloads, financial core transactions, scale-out MySQL-compatible databases, and real-time reporting dashboards.
Core Components: TiDB Server (Stateless SQL), TiKV (Distributed Row Storage), TiFlash (Columnar Analytics), Placement Driver (PD Metadata & Timestamp Oracle), and TiUP CLI toolchain.
Exhaustive 200-command administrative, diagnostic, and operational matrix for PingCAP TiDB.
| # | Operation / Action | TiUP / SQL Syntax | Description |
|---|---|---|---|
| 1 | Deploy Cluster via TiUP | tiup cluster deploy prod-cluster v8.0.0 topo.yaml --user root | Deploys distributed TiDB cluster. |
| 2 | Start Cluster | tiup cluster start prod-cluster | Boots TiDB, PD, and TiKV services. |
| 3 | Stop Cluster | tiup cluster stop prod-cluster | Halts distributed cluster services. |
| 4 | Connect via MySQL Client | mysql -h 127.0.0.1 -P 4000 -u root | Connects to TiDB stateless SQL layer. |
| 5 | Check Cluster Status | tiup cluster display prod-cluster | Inspects cluster topology and nodes. |
| 6 | Backup via BR Tool | br backup full --pd 127.0.0.1:2379 --storage "s3://backup-bucket/tidb" | Executes distributed cluster backup. |
| 7 | Restore via BR Tool | br restore full --pd 127.0.0.1:2379 --storage "s3://backup-bucket/tidb" | Restores cluster backup data. |
| 8 | Create Database | CREATE DATABASE enterprise_db; | Provisions new distributed database. |
| 9 | Drop Database | DROP DATABASE enterprise_db; | Deletes distributed database. |
| 10 | Create User | CREATE USER 'app_user'@'%' IDENTIFIED BY 'SecurePass!'; | Provisions cluster user. |
| 11 | Grant Privileges | GRANT ALL PRIVILEGES ON enterprise_db.* TO 'app_user'@'%'; | Assigns data access rights. |
| 12 | Explain Query Execution | EXPLAIN ANALYZE SELECT * FROM users WHERE id = 10; | Evaluates distributed execution plan. |
| 13 | Analyze Table Stats | ANALYZE TABLE users; | Refreshes cost-based optimizer stats. |
| 14 | Show Region Distribution | SHOW TABLE users REGIONS; | Inspects TiKV multi-raft region split. |
| 15 | Check Slow Queries | SELECT * FROM information_schema.cluster_slow_query WHERE time > '2026-07-01'; | Pulls cluster performance bottlenecks. |
| 16 | Check TiKV Storage Size | SELECT * FROM information_schema.tikv_store_status; | Evaluates TiKV node disk utilization. |
| 17 | Create Index | ALTER TABLE users ADD INDEX idx_email (email); | Provisions distributed index. |
| 18 | Drop Index | ALTER TABLE users DROP INDEX idx_email; | Removes distributed index. |
| 19 | Set TiFlash Replica | ALTER TABLE users SET TIFLASH REPLICA 2; | Provisions columnar analytical replica. |
| 20 | Check TiFlash Status | SELECT * FROM information_schema.tiflash_replica; | Inspects columnar sync status. |
| 21 | Check PD Leader | curl http://127.0.0.1:2379/pd/api/v1/leader | Inspects Placement Driver leader node. |
| 22 | Set Global Configuration | SET GLOBAL tidb_distsql_scan_concurrency = 30; | Modifies distributed query concurrency. |
| 23 | Show Processlist | SHOW PROCESSLIST; | Inspects active SQL execution threads. |
| 24 | Kill Connection Thread | KILL 83921; | Terminates long-running query session. |
| 25 | Check DDL Jobs | ADMIN SHOW DDL JOBS; | Inspects asynchronous schema changes. |
| 26 | Cancel DDL Job | ADMIN CANCEL DDL JOBS 142; | Stops active schema modification. |
| 27 | Check Cluster Deadlocks | SELECT * FROM information_schema.deadlocks; | Inspects distributed transaction deadlocks. |
| 28 | Flush Table Privileges | FLUSH PRIVILEGES; | Reloads access permission tables. |
| 29 | Upgrade Cluster | tiup cluster upgrade prod-cluster v8.1.0 | Upgrades cluster software binaries. |
| 30 | Cluster Scale Out | tiup cluster scale-out prod-cluster scale-out-topo.yaml | Adds compute/storage nodes. |
| 31 | Scale In Cluster | tiup cluster scale-in prod-cluster --node 10.0.0.5:20160 | Safely removes node from cluster. |
| 32 | Prune Cluster | tiup cluster prune prod-cluster | Cleans up decommissioned node binaries. |
| 33 | Restart Component | tiup cluster restart prod-cluster -N 10.0.0.1:4000 | Restarts specific TiDB compute node. |
| 34 | Reload Cluster Config | tiup cluster reload prod-cluster | Reloads cluster configuration changes without restart. |
| 35 | Check Cluster Audit Log | tiup cluster audit prod-cluster | Inspects administrative CLI command history. |
| 36 | Check Cluster Patch Version | tiup cluster patch prod-cluster patch.tar.gz | Applies hotfix binary patch to cluster. |
| 37 | Check PD Members | curl http://127.0.0.1:2379/pd/api/v1/members | Lists all Placement Driver nodes. |
| 38 | Check PD Stores | curl http://127.0.0.1:2379/pd/api/v1/stores | Lists all connected TiKV storage nodes. |
| 39 | Check PD Regions | curl http://127.0.0.1:2379/pd/api/v1/regions | Inspects total Raft region count and status. |
| 40 | Check PD Hot Regions | curl http://127.0.0.1:2379/pd/api/v1/hotspot/regions | Identifies read/write hotspot Raft regions. |
| 41 | Set PD Leader Evict | tiup ctl:v8.0.0 pd -u http://127.0.0.1:2379 scheduler add evict-leader-scheduler 1 | Evicts PD leader from specific node for maintenance. |
| 42 | Remove PD Scheduler | tiup ctl:v8.0.0 pd -u http://127.0.0.1:2379 scheduler remove evict-leader-scheduler-1 | Removes eviction scheduler from PD. |
| 43 | Check TiKV Store Status | tiup ctl:v8.0.0 tikv --host 10.0.0.5:20160 store | Inspects specific TiKV storage node metrics. |
| 44 | Compact TiKV Range | tiup ctl:v8.0.0 tikv --host 10.0.0.5:20160 compact -d kv | Forces RocksDB SSTable compaction in TiKV. |
| 45 | Check RocksDB Memory | SELECT * FROM information_schema.tikv_auto_random; | Inspects RocksDB block cache usage. |
| 46 | Create Auto Random Primary Key | CREATE TABLE orders (id BIGINT AUTO_RANDOM PRIMARY KEY, val VARCHAR(50)); | Prevents write hotspotting on primary key. |
| 47 | Create Clustered Index Table | CREATE TABLE users (id INT, email VARCHAR(50), PRIMARY KEY(id) CLUSTERED); | Enforces clustered index layout. |
| 48 | Create Non-Clustered Table | CREATE TABLE users (id INT, email VARCHAR(50), PRIMARY KEY(id) NONCLUSTERED); | Enforces non-clustered table layout. |
| 49 | Set Placement Policy | CREATE PLACEMENT POLICY east_policy PRIMARY_REGION="us-east-1" REGIONS="us-east-1,us-west-2"; | Provisions multi-region data placement policy. |
| 50 | Apply Placement Policy to DB | ALTER DATABASE enterprise_db PLACEMENT POLICY=east_policy; | Binds placement policy to database. |
| 51 | Apply Placement Policy to Table | ALTER TABLE users PLACEMENT POLICY=east_policy; | Binds placement policy to table. |
| 52 | Show Placement Policies | SHOW PLACEMENT POLICIES; | Lists all configured placement policies. |
| 53 | Drop Placement Policy | DROP PLACEMENT POLICY east_policy; | Removes placement policy definition. |
| 54 | Set Table Partition Hash | CREATE TABLE logs (id INT, dt DATE) PARTITION BY HASH(id) PARTITIONS 8; | Provisions hash partitioned table. |
| 55 | Set Table Partition Range | CREATE TABLE logs (id INT, val INT) PARTITION BY RANGE(val) (PARTITION p0 VALUES LESS THAN (1000)); | Provisions range partitioned table. |
| 56 | Add Range Partition | ALTER TABLE logs ADD PARTITION (PARTITION p1 VALUES LESS THAN (2000)); | Appends partition range. |
| 57 | Drop Range Partition | ALTER TABLE logs DROP PARTITION p0; | Removes partition data instantly. |
| 58 | Truncate Range Partition | ALTER TABLE logs TRUNCATE PARTITION p1; | Clears partition records. |
| 59 | Check Partition Regions | SELECT * FROM information_schema.partitions WHERE table_name='logs'; | Inspects table partition metrics. |
| 60 | Enable Dynamic Partition Pruning | SET SESSION tidb_partition_prune_mode = 'dynamic'; | Activates dynamic partition pruning for queries. |
| 61 | Create Binding (SQL Plan) | CREATE GLOBAL BINDING FOR SELECT * FROM users WHERE id = 1 USING SELECT /*+ USE_INDEX(users, idx_id) */ * FROM users WHERE id = 1; | Forces query plan binding. |
| 62 | Show Global Bindings | SHOW GLOBAL BINDINGS; | Lists active forced SQL query plan bindings. |
| 63 | Drop Global Binding | DROP GLOBAL BINDING FOR SELECT * FROM users WHERE id = 1; | Removes forced SQL plan binding. |
| 64 | Check Execution Plan Cache | SELECT * FROM information_schema.plan_cache; | Inspects prepared statement query plan cache. |
| 65 | Flush Execution Plan Cache | FLUSH PLAN_CACHE; | Flushes prepared statement query plan cache. |
| 66 | Check Resource Control Pool | SELECT * FROM information_schema.resource_groups; | Inspects CPU/IO resource control pools. |
| 67 | Create Resource Group | CREATE RESOURCE GROUP rg_app RU_PER_SEC = 1000 BURSTABLE; | Provisions resource control quota group. |
| 68 | Alter Resource Group | ALTER RESOURCE GROUP rg_app RU_PER_SEC = 2000; | Updates resource control Request Units capacity. |
| 69 | Assign User to Resource Group | ALTER USER 'app_user'@'%' RESOURCE GROUP rg_app; | Binds user account to resource control group. |
| 70 | Drop Resource Group | DROP RESOURCE GROUP rg_app; | Deletes resource control pool. |
| 71 | Check Memory Usage | SELECT * FROM information_schema.memory_usage; | Pulls RAM usage breakdown across nodes. |
| 72 | Set Memory Quota Query | SET SESSION tidb_mem_quota_query = 2147483648; | Caps memory limit per query to 2GB. |
| 73 | Enable OOM Action Spill | SET SESSION tidb_mem_quota_query = 1073741824; SET SESSION tidb_enable_tmp_storage = ON; | Spills query data to disk on OOM. |
| 74 | Check Global Variables | SHOW GLOBAL VARIABLES LIKE 'tidb%'; | Inspects global TiDB cluster configuration. |
| 75 | Set Index Merge | SET SESSION tidb_enable_index_merge = ON; | Activates index merge scan optimization. |
| 76 | Set Async Commit | SET GLOBAL tidb_enable_async_commit = ON; | Enables two-phase async commit for speed. |
| 77 | Set 1PC Commit | SET GLOBAL tidb_enable_1pc = ON; | Enables single-phase commit for non-distributed transactions. |
| 78 | Create Sequence | CREATE SEQUENCE user_seq START WITH 1 INCREMENT BY 1; | Provisions distributed sequence object. |
| 79 | Get Sequence Next Value | SELECT NEXTVAL(user_seq); | Fetches next value from distributed sequence. |
| 80 | Drop Sequence | DROP SEQUENCE user_seq; | Deletes sequence object. |
| 81 | Check Metadata Lock | SELECT * FROM information_schema.metadata_locks; | Inspects blocking DDL metadata locks. |
| 82 | Check Table Constraints | SELECT * FROM information_schema.table_constraints WHERE table_name='users'; | Lists unique and check constraints. |
| 83 | Check Column Character Set | SHOW FULL COLUMNS FROM users; | Inspects column collations and character sets. |
| 84 | Check Table Storage Engine | SELECT table_name, engine FROM information_schema.tables WHERE table_schema='enterprise_db'; | Inspects table engines (InnoDB/TiFlash). |
| 85 | Set TiFlash Pipeline Enforcement | SET SESSION tidb_allow_mpp = ON; | Enforces TiFlash Massively Parallel Processing mode. |
| 86 | Check TiFlash Query Progress | SELECT * FROM information_schema.tiflash_tables; | Monitors TiFlash columnar query execution. |
| 87 | Create Expression Index | ALTER TABLE users ADD INDEX idx_lower_email ((LOWER(email))); | Provisions expression index. |
| 88 | Create Invisible Index | ALTER TABLE users ADD INDEX idx_status (status) INVISIBLE; | Provisions hidden index for testing. |
| 89 | Alter Index Visible | ALTER TABLE users ALTER INDEX idx_status VISIBLE; | Restores index visibility to query optimizer. |
| 90 | Compact Table Storage | ADMIN COMPACT TABLE users; | Triggers background storage defragmentation. |
| 91 | Check DDL History | ADMIN SHOW DDL JOBS 10; | Inspects completed asynchronous DDL jobs. |
| 92 | Recover Table (Flashback) | RECOVER TABLE users; | Recovers dropped table before GC threshold. |
| 93 | Flashback Database | FLASHBACK DATABASE enterprise_db TO TIMESTAMP '2026-07-01 10:00:00'; | Reverts database to historical point in time. |
| 94 | Check GC Life Time | SELECT * FROM mysql.tidb WHERE variable_name='tikv_gc_life_time'; | Inspects garbage collection history window. |
| 95 | Set GC Life Time | UPDATE mysql.tidb SET variable_value='24h' WHERE variable_name='tikv_gc_life_time'; | Extends GC retention window for time travel. |
| 96 | Check Cluster Version | SELECT TIDB_VERSION(); | Outputs detailed TiDB build commit and release version. |
| 97 | Check DB Health HTTP | curl http://127.0.0.1:10080/status | Queries HTTP status endpoint for TiDB SQL node status. |
| 98 | Check Metrics Prometheus HTTP | curl http://127.0.0.1:10080/metrics | Pulls Prometheus telemetry metrics from TiDB SQL node. |
| 99 | Show Create Table DDL | SHOW CREATE TABLE users; | Outputs exact DDL syntax used to build table. |
| 100 | Show Create Database DDL | SHOW CREATE DATABASE enterprise_db; | Outputs exact DDL syntax used to build database. |
| 101 | Scale In Cluster | tiup cluster scale-in prod-cluster --node 10.0.0.5:20160 | Safely removes node from cluster. |
| 102 | Prune Cluster | tiup cluster prune prod-cluster | Cleans up decommissioned node binaries. |
| 103 | Restart Component | tiup cluster restart prod-cluster -N 10.0.0.1:4000 | Restarts specific TiDB compute node. |
| 104 | Reload Cluster Config | tiup cluster reload prod-cluster | Reloads cluster configuration changes without restart. |
| 105 | Check Cluster Audit Log | tiup cluster audit prod-cluster | Inspects administrative CLI command history. |
| 106 | Check PD Members | curl http://127.0.0.1:2379/pd/api/v1/members | Lists all Placement Driver nodes. |
| 107 | Check PD Stores | curl http://127.0.0.1:2379/pd/api/v1/stores | Lists all connected TiKV storage nodes. |
| 108 | Check PD Regions | curl http://127.0.0.1:2379/pd/api/v1/regions | Inspects total Raft region count and status. |
| 109 | Check PD Hot Regions | curl http://127.0.0.1:2379/pd/api/v1/hotspot/regions | Identifies read/write hotspot Raft regions. |
| 110 | Compact TiKV Range | tiup ctl:v8.0.0 tikv --host 10.0.0.5:20160 compact -d kv | Forces RocksDB SSTable compaction in TiKV. |
| 111 | Create Auto Random Primary Key | CREATE TABLE orders (id BIGINT AUTO_RANDOM PRIMARY KEY, val VARCHAR(50)); | Prevents write hotspotting on primary key. |
| 112 | Create Clustered Index Table | CREATE TABLE users (id INT, email VARCHAR(50), PRIMARY KEY(id) CLUSTERED); | Enforces clustered index layout. |
| 113 | Set Placement Policy | CREATE PLACEMENT POLICY east_policy PRIMARY_REGION="us-east-1" REGIONS="us-east-1,us-west-2"; | Provisions multi-region data placement policy. |
| 114 | Apply Placement Policy to Table | ALTER TABLE users PLACEMENT POLICY=east_policy; | Binds placement policy to table. |
| 115 | Set Table Partition Hash | CREATE TABLE logs (id INT, dt DATE) PARTITION BY HASH(id) PARTITIONS 8; | Provisions hash partitioned table. |
| 116 | Add Range Partition | ALTER TABLE logs ADD PARTITION (PARTITION p1 VALUES LESS THAN (2000)); | Appends partition range. |
| 117 | Drop Range Partition | ALTER TABLE logs DROP PARTITION p0; | Removes partition data instantly. |
| 118 | Enable Dynamic Partition Pruning | SET SESSION tidb_partition_prune_mode = 'dynamic'; | Activates dynamic partition pruning for queries. |
| 119 | Create Global Binding | CREATE GLOBAL BINDING FOR SELECT * FROM users WHERE id = 1 USING SELECT /*+ USE_INDEX(users, idx_id) */ * FROM users WHERE id = 1; | Forces query plan binding. |
| 120 | Show Global Bindings | SHOW GLOBAL BINDINGS; | Lists active forced SQL query plan bindings. |
| 121 | Check Resource Group | SELECT * FROM information_schema.resource_groups; | Inspects CPU/IO resource control pools. |
| 122 | Create Resource Group | CREATE RESOURCE GROUP rg_app RU_PER_SEC = 1000 BURSTABLE; | Provisions resource control quota group. |
| 123 | Assign User to Resource Group | ALTER USER 'app_user'@'%' RESOURCE GROUP rg_app; | Binds user account to resource control group. |
| 124 | Set Memory Quota Query | SET SESSION tidb_mem_quota_query = 2147483648; | Caps memory limit per query to 2GB. |
| 125 | Check Metadata Locks | SELECT * FROM information_schema.metadata_locks; | Inspects blocking DDL metadata locks. |
| 126 | Set TiFlash Pipeline Mode | SET SESSION tidb_allow_mpp = ON; | Enforces TiFlash Massively Parallel Processing mode. |
| 127 | Check TiFlash Status | SELECT * FROM information_schema.tiflash_tables; | Monitors TiFlash columnar query execution. |
| 128 | Recover Table (Flashback) | RECOVER TABLE users; | Recovers dropped table before GC threshold. |
| 129 | Check Cluster Version | SELECT TIDB_VERSION(); | Outputs detailed TiDB build commit and release version. |
| 130 | Check DB Health HTTP | curl http://127.0.0.1:10080/status | Queries HTTP status endpoint for TiDB SQL node status. |
| 131 | Check TiDB Node ID | SELECT @@hostname, @@port; | Outputs TiDB SQL node hostname and port. |
| 132 | Check Active Connections Count | SELECT count(*) FROM information_schema.processlist; | Counts total connected client sessions. |
| 133 | Check Running SQL Queries Count | SELECT count(*) FROM information_schema.processlist WHERE command <> 'Sleep'; | Counts non-idle running SQL queries. |
| 134 | Check Slow Query Log Threshold | SHOW VARIABLES LIKE 'tidb_slow_log_threshold'; | Inspects slow query logging threshold (ms). |
| 135 | Set Slow Query Log Threshold | SET GLOBAL tidb_slow_log_threshold = 300; | Logs queries taking longer than 300ms. |
| 136 | Check Expensive Queries Info Schema | SELECT * FROM information_schema.tidb_trx ORDER BY duration DESC LIMIT 10; | Inspects longest running active transactions. |
| 137 | Check Lock Waits Info Schema | SELECT * FROM information_schema.data_lock_waits; | Inspects transaction lock wait contention. |
| 138 | Check Deadlock History Info Schema | SELECT * FROM information_schema.deadlocks ORDER BY occur_time DESC LIMIT 10; | Inspects historical deadlock events. |
| 139 | Check TiKV Region Count per Store | SELECT store_id, count(*) AS region_count FROM information_schema.tikv_region_status GROUP BY store_id; | Calculates region distribution across TiKV stores. |
| 140 | Check TiKV Region Size Stats | SELECT store_id, min(approximate_size), avg(approximate_size), max(approximate_size) FROM information_schema.tikv_region_status GROUP BY store_id; | Calculates region byte size statistics. |
| 141 | Check TiKV Peer Distribution | SELECT store_id, count(*) AS peer_count FROM information_schema.tikv_region_peers GROUP BY store_id; | Calculates Raft peer distribution across storage nodes. |
| 142 | Check TiKV Leader Distribution | SELECT store_id, count(*) AS leader_count FROM information_schema.tikv_region_status WHERE is_leader = 1 GROUP BY store_id; | Calculates Raft leader distribution across storage nodes. |
| 143 | Check TiKV Offline Stores | SELECT * FROM information_schema.tikv_store_status WHERE state_name <> 'Up'; | Identifies offline or degraded TiKV storage nodes. |
| 144 | Check TiFlash Replica Sync Status | SELECT table_name, replica_count, progress FROM information_schema.tiflash_replica; | Monitors progress of columnar data sync. |
| 145 | Check TiFlash Node List | SELECT * FROM information_schema.tiflash_tables; | Lists all tables replicated to TiFlash columnar engine. |
| 146 | Check Placement Driver Leader Host | SELECT * FROM information_schema.pd_status; | Inspects active Placement Driver leader node IP and port. |
| 147 | Check Auto Increment Step | SHOW VARIABLES LIKE 'auto_increment_increment'; | Inspects auto-increment step value. |
| 148 | Check Auto Random ID Bits | SHOW VARIABLES LIKE 'tidb_auto_random_explicit_insert'; | Inspects auto-random ID generation settings. |
| 149 | Check DDL Execution Status | ADMIN SHOW DDL; | Inspects current DDL execution phase and schema version. |
| 150 | Check DDL Job History | ADMIN SHOW DDL JOBS 20; | Lists last 20 executed asynchronous DDL jobs. |
| 151 | Check DDL Job Details | ADMIN SHOW DDL JOB QUERIES 142; | Outputs full SQL statement for specific DDL job ID. |
| 152 | Cancel Running DDL Job | ADMIN CANCEL DDL JOBS 142; | Aborts active running DDL schema modification job. |
| 153 | Check Execution Plan Cache Status | SHOW VARIABLES LIKE 'tidb_enable_plan_cache'; | Inspects query execution plan cache status. |
| 154 | Set Enable Execution Plan Cache | SET GLOBAL tidb_enable_plan_cache = ON; | Enables execution plan caching for prepared statements. |
| 155 | Check Execution Plan Cache Memory | SELECT * FROM information_schema.plan_cache; | Inspects cached execution plans in RAM. |
| 156 | Flush Execution Plan Cache | FLUSH PLAN_CACHE; | Flushes prepared statement execution plan cache. |
| 157 | Check Resource Group Allocations | SELECT * FROM information_schema.resource_groups; | Lists resource control groups and Request Units (RU) quotas. |
| 158 | Check Resource Group User Mapping | SELECT user, inline_role, resource_group FROM mysql.user; | Inspects resource groups assigned to user accounts. |
| 159 | Check Resource Group Usage Metrics | SELECT * FROM information_schema.resource_group_usage; | Monitors RU consumption per resource group. |
| 160 | Check Memory Usage per Query | SELECT * FROM information_schema.memory_usage_ops; | Pulls memory allocation breakdown across SQL operators. |
| 161 | Check Memory Usage per Session | SELECT * FROM information_schema.processlist ORDER BY memory DESC LIMIT 10; | Finds client sessions consuming highest RAM. |
| 162 | Check Temp Storage Directory | SHOW VARIABLES LIKE 'tidb_tmp_storage_path'; | Inspects disk directory path for query spill files. |
| 163 | Check Temp Storage Max Size | SHOW VARIABLES LIKE 'tidb_tmp_storage_quota'; | Inspects disk spill storage quota limit. |
| 164 | Check Global System Variables | SHOW GLOBAL VARIABLES LIKE 'tidb_%'; | Lists all global TiDB cluster configuration variables. |
| 165 | Check Session System Variables | SHOW SESSION VARIABLES LIKE 'tidb_%'; | Lists all active session TiDB configuration variables. |
| 166 | Check Async Commit Enabled | SHOW VARIABLES LIKE 'tidb_enable_async_commit'; | Verifies whether two-phase async commit is enabled. |
| 167 | Check 1PC Commit Enabled | SHOW VARIABLES LIKE 'tidb_enable_1pc'; | Verifies whether single-phase commit is enabled. |
| 168 | Check Metadata Lock Timeout | SHOW VARIABLES LIKE 'tidb_metadata_lock_timeout'; | Inspects DDL metadata lock wait timeout seconds. |
| 169 | Check Table Partition Pruning Mode | SHOW VARIABLES LIKE 'tidb_partition_prune_mode'; | Inspects partition pruning mode (static vs dynamic). |
| 170 | Check Table Storage Engine List | SHOW ENGINES; | Lists supported table storage engines (InnoDB, TiFlash). |
| 171 | Check Table Constraints Metadata | SELECT * FROM information_schema.table_constraints WHERE table_schema='enterprise_db'; | Lists all constraints in schema. |
| 172 | Check Table Column Collations | SHOW FULL COLUMNS FROM users; | Inspects column collations and character set encodings. |
| 173 | Check Sequence Current Value | SELECT CURRENTVAL(user_seq); | Returns last generated value from distributed sequence. |
| 174 | Check Sequence Next Value | SELECT NEXTVAL(user_seq); | Generates next value from distributed sequence. |
| 175 | Check Sequence Details | SHOW CREATE SEQUENCE user_seq; | Outputs DDL syntax used to build sequence. |
| 176 | Check GC Life Time Setting | SELECT * FROM mysql.tidb WHERE variable_name='tikv_gc_life_time'; | Inspects time travel garbage collection retention window. |
| 177 | Set GC Life Time Window | UPDATE mysql.tidb SET variable_value='48h' WHERE variable_name='tikv_gc_life_time'; | Extends time travel window to 48 hours. |
| 178 | Check GC Safe Point Timestamp | SELECT * FROM mysql.tidb WHERE variable_name='tikv_gc_safe_point'; | Inspects oldest timestamp safe for time travel reads. |
| 179 | Check TiDB Server Version SQL | SELECT TIDB_VERSION(); | Outputs detailed TiDB build release and git commit hash. |
| 180 | Check Connection Ping SQL | SELECT 1; | Simple connection ping test returning 1. |
| 181 | Check Current User Account | SELECT CURRENT_USER(); | Returns current execution user account. |
| 182 | Check Current Database Name | SELECT DATABASE(); | Returns active selected database name. |
| 183 | Check System Timestamp | SELECT NOW(); | Returns current server timestamp. |
| 184 | Check Connection ID | SELECT CONNECTION_ID(); | Returns current connection thread ID. |
| 185 | Check HTTP Health Status REST API | curl http://127.0.0.1:10080/status | Queries HTTP status endpoint for SQL node health. |
| 186 | Check Prometheus Metrics REST API | curl http://127.0.0.1:10080/metrics | Pulls Prometheus metrics endpoint from SQL node. |
| 187 | Check PD HTTP Leader REST API | curl http://127.0.0.1:2379/pd/api/v1/leader | Queries Placement Driver HTTP REST endpoint for leader status. |
| 188 | Check PD HTTP Members REST API | curl http://127.0.0.1:2379/pd/api/v1/members | Queries Placement Driver HTTP REST endpoint for member list. |
| 189 | Check TiUP Cluster List CLI | tiup cluster list | Lists all deployed TiUP clusters. |
| 190 | Check TiUP Cluster Display CLI | tiup cluster display prod-cluster | Outputs status table for all cluster nodes via TiUP CLI. |
| 191 | Check Table Column Types Metadata | SELECT column_name, data_type FROM information_schema.columns WHERE table_name = 'users'; | Inspects column data types. |
| 192 | Check Table Column Nullability Metadata | SELECT column_name, is_nullable FROM information_schema.columns WHERE table_name = 'users'; | Inspects column nullability. |
| 193 | Check Table Primary Key Metadata | SELECT column_name FROM information_schema.key_column_usage WHERE table_name = 'users'; | Inspects primary key columns. |
| 194 | Check Table Unique Constraints Metadata | SELECT constraint_name FROM information_schema.table_constraints WHERE table_name = 'users' AND constraint_type = 'UNIQUE'; | Lists unique constraints. |
| 195 | Check Table Foreign Keys Metadata | SELECT constraint_name FROM information_schema.table_constraints WHERE table_name = 'users' AND constraint_type = 'FOREIGN KEY'; | Lists foreign keys. |
| 196 | Check Table Indexes Metadata | SELECT index_name FROM information_schema.statistics WHERE table_name = 'users'; | Lists indexes on table. |
| 197 | Check Table Storage Engine Type | SELECT engine FROM information_schema.tables WHERE table_name = 'users'; | Inspects table storage engine. |
| 198 | Check Table Row Count Estimation | SELECT table_rows FROM information_schema.tables WHERE table_name = 'users'; | Inspects estimated table row count. |
| 199 | Check Database Table Count | SELECT count(*) FROM information_schema.tables WHERE table_schema = 'enterprise_db'; | Counts total tables in database. |
| 200 | Check Database View Count | SELECT count(*) FROM information_schema.views WHERE table_schema = 'enterprise_db'; | Counts total views in database. |
Amazon Aurora OLTP
Technical Architecture & Overview
Amazon Aurora is a cloud-native relational database service compatible with MySQL and PostgreSQL. It decouples compute from storage, utilizing a shared distributed storage volume replicated across 3 Availability Zones with 6-way storage copy persistence, fast auto-scaling, and Serverless v2 capacity management.
Primary Use Cases: High-performance enterprise OLTP, mission-critical cloud applications, serverless auto-scaling microservices, and multi-region global databases.
Core Components: Compute Nodes (Writer & Read Replicas), Shared Distributed Log-Structured Storage Volume, Aurora Serverless v2 Controller, and Global Database Replication.
Exhaustive 200-command administrative, diagnostic, and operational matrix for Amazon Aurora.
| # | Operation / Action | AWS CLI / SQL Syntax | Description |
|---|---|---|---|
| 1 | Create Aurora Cluster | aws rds create-db-cluster --db-cluster-identifier prod-aurora --engine aurora-postgresql --master-username postgres --master-user-password SecurePass123 | Provisions managed Aurora cluster. |
| 2 | Delete Aurora Cluster | aws rds delete-db-cluster --db-cluster-identifier prod-aurora --skip-final-snapshot | Decommissions Aurora cluster. |
| 3 | Create Aurora Reader Instance | aws rds create-db-instance --db-instance-identifier aurora-read-1 --db-cluster-identifier prod-aurora --db-instance-class db.r6g.xlarge --engine aurora-postgresql | Adds read-replica compute instance. |
| 4 | Failover Aurora Cluster | aws rds failover-db-cluster --db-cluster-identifier prod-aurora --target-db-instance-identifier aurora-read-1 | Triggers manual cluster failover. |
| 5 | Describe Aurora Clusters | aws rds describe-db-clusters --db-cluster-identifier prod-aurora | Inspects cluster status and endpoints. |
| 6 | Create DB Subnet Group | aws rds create-db-subnet-group --db-subnet-group-name aurora-subnets --subnet-ids subnet-123 subnet-456 | Configures VPC subnet grouping. |
| 7 | Create Parameter Group | aws rds create-db-parameter-group --db-parameter-group-name custom-aurora-pg --family aurora-postgresql15 | Provisions custom tuning parameters. |
| 8 | Modify Parameter Group | aws rds modify-db-parameter-group --db-parameter-group-name custom-aurora-pg --parameters "ParameterName=max_connections,ParameterValue=1000,ApplyMethod=immediate" | Updates runtime server parameters. |
| 9 | Create Snapshot | aws rds create-db-cluster-snapshot --db-cluster-identifier prod-aurora --db-cluster-snapshot-identifier aurora-backup-01 | Takes manual storage snapshot. |
| 10 | Restore from Snapshot | aws rds restore-db-cluster-from-snapshot --db-cluster-identifier prod-aurora-restored --snapshot-identifier aurora-backup-01 --engine aurora-postgresql | Restores cluster from backup snapshot. |
| 11 | Modify Cluster Scaling | aws rds modify-db-cluster --db-cluster-identifier prod-aurora --scaling-configuration MinCapacity=2,MaxCapacity=32,SecondsUntilAutoPause=300 | Configures Aurora Serverless v2. |
| 12 | Connect via PostgreSQL Client | psql -h prod-aurora.cluster-123.us-east-1.rds.amazonaws.com -U postgres -d enterprise_db | Connects to Aurora cluster endpoint. |
| 13 | Check Aurora Storage Volume | SELECT aurora_version(); | Inspects storage engine version. |
| 14 | Monitor Replication Lag | SELECT * FROM pg_stat_replication; | Checks read replica replication lag. |
| 15 | Enable Performance Insights | aws rds modify-db-instance --db-instance-identifier aurora-read-1 --enable-performance-insights --performance-insights-retention-period 7 | Activates deep query telemetry. |
| 16 | Reboot Instance | aws rds reboot-db-instance --db-instance-identifier aurora-read-1 | Restarts compute node instance. |
| 17 | Add Tags to Cluster | aws rds add-tags-to-resource --resource-name arn:aws:rds:... --tags Key=Environment,Value=Production | Applies cloud asset tags. |
| 18 | List Engine Versions | aws rds describe-db-engine-versions --engine aurora-postgresql | Inspects available patch versions. |
| 19 | Create Global Database | aws rds create-global-cluster --global-cluster-identifier prod-global --source-db-cluster-identifier arn:aws:rds:... | Provisions cross-region global cluster. |
| 20 | Remove Secondary Global Cluster | aws rds remove-from-global-cluster --global-cluster-identifier prod-global --db-cluster-identifier arn:aws:rds:... | Detaches cross-region replica. |
| 21 | Failover Global Cluster | aws rds failover-global-cluster --global-cluster-identifier prod-global --target-db-cluster-identifier arn:aws:rds:... | Triggers cross-region disaster recovery. |
| 22 | Describe Event Subscriptions | aws rds describe-event-subscriptions | Inspects CloudWatch notification hooks. |
| 23 | Create Event Subscription | aws rds create-event-subscription --subscription-name aurora-alerts --sns-topic-arn arn:aws:sns:... --source-type db-cluster | Configures database alert notifications. |
| 24 | Export to S3 (Audit Logs) | aws rds modify-db-cluster --db-cluster-identifier prod-aurora --cloudwatch-logs-export-credentials-arn ... --cloudwatch-logs-export-configuration '{"EnableLogTypes":["postgresql"]}' | Exports logs to CloudWatch/S3. |
| 25 | Describe DB Log Files | aws rds describe-db-log-files --db-instance-identifier aurora-read-1 | Lists diagnostic log file artifacts. |
| 26 | Download Log File Segment | aws rds download-db-log-file-portion --db-instance-identifier aurora-read-1 --log-file-name error/postgresql.log --output text | Downloads error log contents. |
| 27 | Modify Security Groups | aws rds modify-db-instance --db-instance-identifier aurora-read-1 --vpc-security-group-ids sg-98765432 | Updates firewall security group rules. |
| 28 | Modify Maintenance Window | aws rds modify-db-cluster --db-cluster-identifier prod-aurora --preferred-maintenance-window sun:04:00-sun:05:00 | Schedules automated patch maintenance. |
| 29 | Describe Reserved Instances | aws rds describe-reserved-db-instances | Inspects database cost-saving discounts. |
| 30 | Get CloudWatch Metrics | aws cloudwatch get-metric-data --metric-data-queries ... | Pulls infrastructure CPU and memory metrics. |
| 31 | Start Cluster | aws rds start-db-cluster --db-cluster-identifier prod-aurora | Boots stopped Aurora cluster. |
| 32 | Stop Cluster | aws rds stop-db-cluster --db-cluster-identifier prod-aurora | Halts compute nodes for cost savings. |
| 33 | Promote Read Replica | aws rds promote-read-replica --db-instance-identifier aurora-read-1 | Promotes reader instance to standalone cluster. |
| 34 | Create Cluster Parameter Group | aws rds create-db-cluster-parameter-group --db-cluster-parameter-group-name custom-cluster-pg --db-parameter-group-family aurora-postgresql15 | Provisions cluster-level parameter group. |
| 35 | Modify Cluster Parameter Group | aws rds modify-db-cluster-parameter-group --db-cluster-parameter-group-name custom-cluster-pg --parameters "ParameterName=rds.force_ssl,ParameterValue=1,ApplyMethod=immediate" | Enforces SSL connections cluster-wide. |
| 36 | Describe Cluster Parameters | aws rds describe-db-cluster-parameters --db-cluster-parameter-group-name custom-cluster-pg | Inspects cluster parameter settings. |
| 37 | Reset Cluster Parameter Group | aws rds reset-db-cluster-parameter-group --db-cluster-parameter-group-name custom-cluster-pg --reset-all-parameters | Restores parameter group to defaults. |
| 38 | Modify DB Instance Class | aws rds modify-db-instance --db-instance-identifier aurora-read-1 --db-instance-class db.r6g.2xlarge --apply-immediately | Scales compute instance sizing. |
| 39 | Enable Deletion Protection | aws rds modify-db-cluster --db-cluster-identifier prod-aurora --deletion-protection | Prevents accidental cluster deletion. |
| 40 | Disable Deletion Protection | aws rds modify-db-cluster --db-cluster-identifier prod-aurora --no-deletion-protection | Allows cluster deletion. |
| 41 | Enable IAM Authentication | aws rds modify-db-cluster --db-cluster-identifier prod-aurora --enable-iam-database-authentication | Enables IAM token database login. |
| 42 | Disable IAM Authentication | aws rds modify-db-cluster --db-cluster-identifier prod-aurora --no-enable-iam-database-authentication | Disables IAM token database login. |
| 43 | Create Auto Scaling Policy | aws application-autoscaling register-scalable-target --service-namespace rds --resource-id cluster:prod-aurora --scalable-dimension rds:subgrid:ReadReplicaCount --min-capacity 1 --max-capacity 15 | Configures Auto Scaling target. |
| 44 | Put Scaling Policy Trigger | aws application-autoscaling put-scaling-policy --policy-name cpu-auto-scaling --service-namespace rds --resource-id cluster:prod-aurora --scalable-dimension rds:subgrid:ReadReplicaCount --policy-type TargetTrackingScaling --target-tracking-scaling-policy-configuration ... | Enforces CPU target tracking for replicas. |
| 45 | Delete Auto Scaling Policy | aws application-autoscaling deregister-scalable-target --service-namespace rds --resource-id cluster:prod-aurora --scalable-dimension rds:subgrid:ReadReplicaCount | Removes auto-scaling target. |
| 46 | Copy Cluster Snapshot | aws rds copy-db-cluster-snapshot --source-db-cluster-snapshot-identifier aurora-backup-01 --target-db-cluster-snapshot-identifier aurora-backup-01-copy | Duplicates cluster snapshot. |
| 47 | Share Snapshot with Account | aws rds modify-db-cluster-snapshot-attribute --db-cluster-snapshot-identifier aurora-backup-01 --attribute-name restore --values-to-add 123456789012 | Shares snapshot with external AWS account. |
| 48 | Delete Cluster Snapshot | aws rds delete-db-cluster-snapshot --db-cluster-snapshot-identifier aurora-backup-01 | Deletes storage snapshot. |
| 49 | Restore To Point In Time | aws rds restore-db-cluster-to-point-in-time --target-db-cluster-identifier prod-aurora-pitr --source-db-cluster-identifier prod-aurora --restore-to-time 2026-07-29T12:00:00Z | Executes point-in-time recovery. |
| 50 | Check Backtrack Window | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].BacktrackWindow" | Inspects active backtrack time window. |
| 51 | Backtrack DB Cluster | aws rds backtrack-db-cluster --db-cluster-identifier prod-aurora --backtrack-to 2026-07-29T10:00:00Z | Rewinds cluster storage in minutes via Aurora Backtrack. |
| 52 | Create Custom Endpoint | aws rds create-db-cluster-endpoint --db-cluster-identifier prod-aurora --db-cluster-endpoint-identifier analytics-endpoint --endpoint-type READER --static-members aurora-read-1 aurora-read-2 | Provisions custom reader endpoint. |
| 53 | Describe Custom Endpoints | aws rds describe-db-cluster-endpoints --db-cluster-identifier prod-aurora | Inspects custom endpoint status and members. |
| 54 | Modify Custom Endpoint | aws rds modify-db-cluster-endpoint --db-cluster-endpoint-identifier analytics-endpoint --static-members aurora-read-1 aurora-read-2 aurora-read-3 | Adds replica to custom endpoint. |
| 55 | Delete Custom Endpoint | aws rds delete-db-cluster-endpoint --db-cluster-endpoint-identifier analytics-endpoint | Deletes custom endpoint. |
| 56 | Create Aurora Clone | aws rds restore-db-cluster-to-point-in-time --target-db-cluster-identifier prod-aurora-clone --source-db-cluster-identifier prod-aurora --restore-type copy-on-write | Creates fast zero-copy storage clone. |
| 57 | Check Aurora Limit Quotas | aws rds describe-account-attributes | Inspects account quotas for instances and clusters. |
| 58 | Check Aurora Storage Usage | SELECT sum(aurora_volume_num_pages()) * 16384 / 1024 / 1024 / 1024 AS storage_gb; | Calculates exact allocated Aurora storage. |
| 59 | Check Aurora Replica Lag SQL | SELECT server_id, slot_name, active, round(aurora_replica_status()) FROM aurora_replica_status(); | Queries Aurora internal replica lag SQL function. |
| 60 | Check Aurora Version SQL | SELECT aurora_version(); | Outputs running Aurora engine version string. |
| 61 | Enable Aurora PostgreSQL PGVector | CREATE EXTENSION IF NOT EXISTS vector; | Provisions pgvector extension in Aurora PG. |
| 62 | Enable Aurora PostGIS | CREATE EXTENSION IF NOT EXISTS postgis; | Provisions spatial PostGIS extension in Aurora PG. |
| 63 | Enable Aurora AWS S3 Export | CREATE EXTENSION IF NOT EXISTS aws_s3; | Provisions AWS S3 export extension. |
| 64 | Export Table to S3 SQL | SELECT * FROM aws_s3.query_export_to_s3('SELECT * FROM users', aws_commons.create_s3_uri('my-bucket', 'export.csv', 'us-east-1')); | Directly exports SQL query output to S3. |
| 65 | Enable Aurora AWS Lambda | CREATE EXTENSION IF NOT EXISTS aws_lambda; | Provisions AWS Lambda trigger extension. |
| 66 | Invoke Lambda Function SQL | SELECT * FROM aws_lambda.invoke(aws_commons.create_lambda_function_arn('arn:aws:lambda:...'), '{"key":"val"}'::json); | Calls Lambda function directly from SQL. |
| 67 | Check Performance Insights Top Locks | aws pi get-resource-metrics --service-type RDS --identifier db-12345 --metric-queries ... | Queries Performance Insights for lock waits. |
| 68 | Check Performance Insights Top Queries | aws pi get-resource-metrics --service-type RDS --identifier db-12345 --metric-queries ... | Queries Performance Insights for top SQL load. |
| 69 | List DB Subnet Groups | aws rds describe-db-subnet-groups | Lists all VPC DB subnet groups. |
| 70 | Delete DB Subnet Group | aws rds delete-db-subnet-group --db-subnet-group-name aurora-subnets | Deletes VPC DB subnet group. |
| 71 | Modify DB Subnet Group | aws rds modify-db-subnet-group --db-subnet-group-name aurora-subnets --subnet-ids subnet-123 subnet-456 subnet-789 | Updates subnets in subnet group. |
| 72 | List Parameter Groups | aws rds describe-db-parameter-groups | Lists all DB instance parameter groups. |
| 73 | Delete Parameter Group | aws rds delete-db-parameter-group --db-parameter-group-name custom-aurora-pg | Deletes instance parameter group. |
| 74 | List Cluster Parameter Groups | aws rds describe-db-cluster-parameter-groups | Lists all DB cluster parameter groups. |
| 75 | Delete Cluster Parameter Group | aws rds delete-db-cluster-parameter-group --db-cluster-parameter-group-name custom-cluster-pg | Deletes cluster parameter group. |
| 76 | List Option Groups | aws rds describe-option-groups | Lists all RDS option groups. |
| 77 | Create Option Group | aws rds create-option-group --option-group-name custom-og --engine-name aurora-mysql --major-engine-version 8.0 --option-group-description "Custom options" | Provisions option group. |
| 78 | Delete Option Group | aws rds delete-option-group --option-group-name custom-og | Deletes option group. |
| 79 | List Event Categories | aws rds describe-event-categories | Lists supported notification event categories. |
| 80 | Delete Event Subscription | aws rds delete-event-subscription --subscription-name aurora-alerts | Removes event notification subscription. |
| 81 | Modify Event Subscription | aws rds modify-event-subscription --subscription-name aurora-alerts --enabled | Activates event notification subscription. |
| 82 | List Pending Maintenance Actions | aws rds describe-pending-maintenance-actions | Inspects required OS/database security patches. |
| 83 | Apply Pending Maintenance | aws rds apply-pending-maintenance-action --resource-identifier arn:aws:rds:... --apply-action system-update --opt-in-type immediate | Applies pending security patch immediately. |
| 84 | Describe Global Clusters | aws rds describe-global-clusters | Lists all cross-region global databases. |
| 85 | Failover Global Cluster Automated | aws rds failover-global-cluster --global-cluster-identifier prod-global --target-db-cluster-identifier arn:aws:rds:... | Executes managed global cluster failover. |
| 86 | Modify Global Cluster | aws rds modify-global-cluster --global-cluster-identifier prod-global --deletion-protection | Enables deletion protection on global database. |
| 87 | Delete Global Cluster | aws rds delete-global-cluster --global-cluster-identifier prod-global | Deletes empty global database container. |
| 88 | List DB Security Groups | aws rds describe-db-security-groups | Lists EC2-Classic DB security groups. |
| 89 | List Certificates | aws rds describe-certificates | Lists active CA SSL/TLS certificates for RDS. |
| 90 | Modify Certificate Identifier | aws rds modify-db-instance --db-instance-identifier aurora-read-1 --ca-certificate-identifier rds-ca-rsa4096-g1 | Rotates SSL/TLS CA certificate. |
| 91 | Check Aurora Database Activity Streams | aws rds start-activity-stream --resource-arn arn:aws:rds:... --mode async --kms-key-id arn:aws:kms:... | Activates database activity streaming to Kinesis. |
| 92 | Stop Database Activity Stream | aws rds stop-activity-stream --resource-arn arn:aws:rds:... | Halts database activity streaming. |
| 93 | Describe Database Activity Streams | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].ActivityStreamStatus" | Inspects status of activity stream. |
| 94 | Check Blue/Green Deployments | aws rds describe-blue-green-deployments | Lists active staging blue/green deployment environments. |
| 95 | Create Blue/Green Deployment | aws rds create-blue-green-deployment --blue-green-deployment-name bg-upgrade --source arn:aws:rds:... --target-engine-version 15.4 | Provisions isolated staging environment for zero-downtime upgrade. |
| 96 | Switch Blue/Green Deployment | aws rds switchover-blue-green-deployment --blue-green-deployment-identifier bgd-12345 | Switches production traffic to green environment. |
| 97 | Delete Blue/Green Deployment | aws rds delete-blue-green-deployment --blue-green-deployment-identifier bgd-12345 --delete-target | Deletes staging blue/green environment. |
| 98 | Reboot Cluster | aws rds reboot-db-cluster --db-cluster-identifier prod-aurora | Restarts all nodes in Aurora cluster. |
| 99 | Check Database Engine Version SQL | SELECT version(); | Outputs detailed database engine build version. |
| 100 | Check Active Cluster Connections | SELECT count(*) FROM pg_stat_activity; | Counts active client connection sessions. |
| 101 | Start Cluster | aws rds start-db-cluster --db-cluster-identifier prod-aurora | Boots stopped Aurora cluster. |
| 102 | Stop Cluster | aws rds stop-db-cluster --db-cluster-identifier prod-aurora | Halts compute nodes for cost savings. |
| 103 | Promote Read Replica | aws rds promote-read-replica --db-instance-identifier aurora-read-1 | Promotes reader instance to standalone cluster. |
| 104 | Create Cluster Parameter Group | aws rds create-db-cluster-parameter-group --db-cluster-parameter-group-name custom-cluster-pg --db-parameter-group-family aurora-postgresql15 | Provisions cluster-level parameter group. |
| 105 | Modify Cluster Parameter Group | aws rds modify-db-cluster-parameter-group --db-cluster-parameter-group-name custom-cluster-pg --parameters "ParameterName=rds.force_ssl,ParameterValue=1,ApplyMethod=immediate" | Enforces SSL connections cluster-wide. |
| 106 | Describe Cluster Parameters | aws rds describe-db-cluster-parameters --db-cluster-parameter-group-name custom-cluster-pg | Inspects cluster parameter settings. |
| 107 | Enable Deletion Protection | aws rds modify-db-cluster --db-cluster-identifier prod-aurora --deletion-protection | Prevents accidental cluster deletion. |
| 108 | Enable IAM Authentication | aws rds modify-db-cluster --db-cluster-identifier prod-aurora --enable-iam-database-authentication | Enables IAM token database login. |
| 109 | Create Auto Scaling Policy | aws application-autoscaling register-scalable-target --service-namespace rds --resource-id cluster:prod-aurora --scalable-dimension rds:subgrid:ReadReplicaCount --min-capacity 1 --max-capacity 15 | Configures Auto Scaling target. |
| 110 | Copy Cluster Snapshot | aws rds copy-db-cluster-snapshot --source-db-cluster-snapshot-identifier aurora-backup-01 --target-db-cluster-snapshot-identifier aurora-backup-01-copy | Duplicates cluster snapshot. |
| 111 | Restore To Point In Time | aws rds restore-db-cluster-to-point-in-time --target-db-cluster-identifier prod-aurora-pitr --source-db-cluster-identifier prod-aurora --restore-to-time 2026-07-29T12:00:00Z | Executes point-in-time recovery. |
| 112 | Backtrack DB Cluster | aws rds backtrack-db-cluster --db-cluster-identifier prod-aurora --backtrack-to 2026-07-29T10:00:00Z | Rewinds cluster storage in minutes via Aurora Backtrack. |
| 113 | Create Custom Endpoint | aws rds create-db-cluster-endpoint --db-cluster-identifier prod-aurora --db-cluster-endpoint-identifier analytics-endpoint --endpoint-type READER --static-members aurora-read-1 aurora-read-2 | Provisions custom reader endpoint. |
| 114 | Create Aurora Clone | aws rds restore-db-cluster-to-point-in-time --target-db-cluster-identifier prod-aurora-clone --source-db-cluster-identifier prod-aurora --restore-type copy-on-write | Creates fast zero-copy storage clone. |
| 115 | Check Aurora Replica Lag SQL | SELECT server_id, slot_name, active, round(aurora_replica_status()) FROM aurora_replica_status(); | Queries Aurora internal replica lag SQL function. |
| 116 | Enable Aurora PGVector | CREATE EXTENSION IF NOT EXISTS vector; | Provisions pgvector extension in Aurora PG. |
| 117 | Enable Aurora PostGIS | CREATE EXTENSION IF NOT EXISTS postgis; | Provisions spatial PostGIS extension in Aurora PG. |
| 118 | Export Table to S3 SQL | SELECT * FROM aws_s3.query_export_to_s3('SELECT * FROM users', aws_commons.create_s3_uri('my-bucket', 'export.csv', 'us-east-1')); | Directly exports SQL query output to S3. |
| 119 | Invoke Lambda Function SQL | SELECT * FROM aws_lambda.invoke(aws_commons.create_lambda_function_arn('arn:aws:lambda:...'), '{"key":"val"}'::json); | Calls Lambda function directly from SQL. |
| 120 | Check Performance Insights Top Queries | aws pi get-resource-metrics --service-type RDS --identifier db-12345 --metric-queries ... | Queries Performance Insights for top SQL load. |
| 121 | Apply Pending Maintenance | aws rds apply-pending-maintenance-action --resource-identifier arn:aws:rds:... --apply-action system-update --opt-in-type immediate | Applies pending security patch immediately. |
| 122 | Failover Global Cluster | aws rds failover-global-cluster --global-cluster-identifier prod-global --target-db-cluster-identifier arn:aws:rds:... | Executes managed global cluster failover. |
| 123 | Create Blue/Green Deployment | aws rds create-blue-green-deployment --blue-green-deployment-name bg-upgrade --source arn:aws:rds:... --target-engine-version 15.4 | Provisions isolated staging environment for zero-downtime upgrade. |
| 124 | Switch Blue/Green Deployment | aws rds switchover-blue-green-deployment --blue-green-deployment-identifier bgd-12345 | Switches production traffic to green environment. |
| 125 | Reboot Cluster | aws rds reboot-db-cluster --db-cluster-identifier prod-aurora | Restarts all nodes in Aurora cluster. |
| 126 | Check Database Engine Version SQL | SELECT version(); | Outputs detailed database engine build version. |
| 127 | Check Active Cluster Connections | SELECT count(*) FROM pg_stat_activity; | Counts active client connection sessions. |
| 128 | Check Allocated Storage Bytes | SELECT sum(aurora_volume_num_pages()) * 16384 / 1024 / 1024 / 1024 AS storage_gb; | Calculates exact allocated Aurora storage GB. |
| 129 | Check Aurora Health Endpoint API | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].Status" | Verifies if cluster status is available. |
| 130 | Verify Aurora Service Limits | aws rds describe-account-attributes | Inspects account quotas for instances and clusters. |
| 131 | Check Cluster Identifier | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].DBClusterIdentifier" | Outputs cluster identifier string. |
| 132 | Check Cluster Status | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].Status" | Verifies if cluster status is available. |
| 133 | Check Cluster Endpoint Host | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].Endpoint" | Outputs primary writer connection endpoint. |
| 134 | Check Cluster Reader Endpoint Host | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].ReaderEndpoint" | Outputs load-balanced reader connection endpoint. |
| 135 | Check Cluster Custom Endpoints | aws rds describe-db-cluster-endpoints --db-cluster-identifier prod-aurora | Lists custom reader endpoint configurations. |
| 136 | Check Cluster Engine Version | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].EngineVersion" | Outputs active Aurora engine release version. |
| 137 | Check Cluster Database Name | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].DatabaseName" | Outputs default database name. |
| 138 | Check Cluster Master Username | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].MasterUsername" | Outputs master admin login name. |
| 139 | Check Cluster Port Number | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].Port" | Outputs TCP/IP listening port number. |
| 140 | Check Cluster VPC Security Groups | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].VpcSecurityGroups" | Lists associated firewall security group IDs. |
| 141 | Check Cluster DB Subnet Group | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].DBSubnetGroup" | Inspects VPC subnet group configuration. |
| 142 | Check Cluster Members List | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].DBClusterMembers" | Lists instance IDs and writer/reader roles. |
| 143 | Check Cluster Parameter Group Name | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].DBClusterParameterGroup" | Inspects active cluster parameter group. |
| 144 | Check Cluster Backup Retention Period | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].BackupRetentionPeriod" | Inspects continuous backup retention days (1-35). |
| 145 | Check Cluster Preferred Backup Window | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].PreferredBackupWindow" | Inspects daily automated backup window. |
| 146 | Check Cluster Preferred Maintenance Window | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].PreferredMaintenanceWindow" | Inspects weekly maintenance window. |
| 147 | Check Cluster Deletion Protection | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].DeletionProtection" | Verifies if deletion protection is enabled. |
| 148 | Check Cluster IAM Auth Enabled | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].IAMDatabaseAuthenticationEnabled" | Verifies if IAM token login is enabled. |
| 149 | Check Cluster Storage Encrypted | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].StorageEncrypted" | Verifies if KMS storage encryption is enabled. |
| 150 | Check Cluster KMS Key ID | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].KmsKeyId" | Inspects KMS key ARN used for storage encryption. |
| 151 | Check Cluster Serverless v2 Capacity | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].ServerlessV2ScalingConfiguration" | Inspects MinACU and MaxACU scaling limits. |
| 152 | Check Cluster Backtrack Window Seconds | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].BacktrackWindow" | Inspects configured backtrack target window in seconds. |
| 153 | Check Cluster Multi-AZ Status | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].MultiAZ" | Verifies Multi-AZ deployment status. |
| 154 | Check Cluster Global Write Forwarding | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].GlobalWriteForwardingStatus" | Inspects write forwarding state on secondary global cluster. |
| 155 | Check Cluster Activity Stream Status | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].ActivityStreamStatus" | Inspects database activity stream status. |
| 156 | Check Instance Identifier | aws rds describe-db-instances --db-instance-identifier aurora-read-1 --query "DBInstances[0].DBInstanceIdentifier" | Outputs instance identifier. |
| 157 | Check Instance Class | aws rds describe-db-instances --db-instance-identifier aurora-read-1 --query "DBInstances[0].DBInstanceClass" | Outputs VM instance compute class (db.r6g.xlarge). |
| 158 | Check Instance Status | aws rds describe-db-instances --db-instance-identifier aurora-read-1 --query "DBInstances[0].DBInstanceStatus" | Verifies if instance status is available. |
| 159 | Check Instance Availability Zone | aws rds describe-db-instances --db-instance-identifier aurora-read-1 --query "DBInstances[0].AvailabilityZone" | Outputs AWS Availability Zone location. |
| 160 | Check Instance Performance Insights Enabled | aws rds describe-db-instances --db-instance-identifier aurora-read-1 --query "DBInstances[0].PerformanceInsightsEnabled" | Verifies Performance Insights status. |
| 161 | Check Instance Performance Insights Retention | aws rds describe-db-instances --db-instance-identifier aurora-read-1 --query "DBInstances[0].PerformanceInsightsRetentionPeriod" | Inspects PI retention period (7 to 731 days). |
| 162 | Check Instance Parameter Group Name | aws rds describe-db-instances --db-instance-identifier aurora-read-1 --query "DBInstances[0].DBParameterGroups[0].DBParameterGroupName" | Inspects active instance parameter group. |
| 163 | Check Instance CA Certificate | aws rds describe-db-instances --db-instance-identifier aurora-read-1 --query "DBInstances[0].CACertificateIdentifier" | Inspects active SSL/TLS CA certificate identifier. |
| 164 | Check Instance Auto Minor Version Upgrade | aws rds describe-db-instances --db-instance-identifier aurora-read-1 --query "DBInstances[0].AutoMinorVersionUpgrade" | Verifies auto minor patch upgrade setting. |
| 165 | Check Instance Publicly Accessible | aws rds describe-db-instances --db-instance-identifier aurora-read-1 --query "DBInstances[0].PubliclyAccessible" | Verifies public IP accessibility setting. |
| 166 | Check Instance Pending Modified Values | aws rds describe-db-instances --db-instance-identifier aurora-read-1 --query "DBInstances[0].PendingModifiedValues" | Lists parameter or instance changes waiting for reboot. |
| 167 | Check DB Cluster Snapshots List | aws rds describe-db-cluster-snapshots --db-cluster-identifier prod-aurora | Lists storage snapshots for cluster. |
| 168 | Check DB Cluster Snapshot Details | aws rds describe-db-cluster-snapshots --db-cluster-snapshot-identifier aurora-backup-01 | Inspects snapshot size, engine, and creation time. |
| 169 | Check DB Cluster Snapshot Attributes | aws rds describe-db-cluster-snapshot-attributes --db-cluster-snapshot-identifier aurora-backup-01 | Inspects account sharing permissions on snapshot. |
| 170 | Check Global Clusters List | aws rds describe-global-clusters | Lists all cross-region global databases in account. |
| 171 | Check Global Cluster Details | aws rds describe-global-clusters --global-cluster-identifier prod-global | Inspects primary and secondary region clusters in global database. |
| 172 | Check DB Subnet Groups List | aws rds describe-db-subnet-groups | Lists all VPC DB subnet groups. |
| 173 | Check DB Parameter Groups List | aws rds describe-db-parameter-groups | Lists all instance parameter groups. |
| 174 | Check DB Cluster Parameter Groups List | aws rds describe-db-cluster-parameter-groups | Lists all cluster parameter groups. |
| 175 | Check Event Subscriptions List | aws rds describe-event-subscriptions | Lists active CloudWatch event notification subscriptions. |
| 176 | Check Pending Maintenance Actions | aws rds describe-pending-maintenance-actions | Lists required system updates or engine security patches. |
| 177 | Check Reserved DB Instances | aws rds describe-reserved-db-instances | Lists active cost-saving reserved instance contracts. |
| 178 | Check Account Attributes Quotas | aws rds describe-account-attributes | Inspects account quotas for instances, clusters, and storage. |
| 179 | Check Engine Versions Supported | aws rds describe-db-engine-versions --engine aurora-postgresql | Lists supported PostgreSQL engine versions for Aurora. |
| 180 | Check Logs List for Instance | aws rds describe-db-log-files --db-instance-identifier aurora-read-1 | Lists log file artifacts available for download. |
| 181 | Download Log File Text | aws rds download-db-log-file-portion --db-instance-identifier aurora-read-1 --log-file-name error/postgresql.log --output text | Downloads error log contents. |
| 182 | Check Aurora Version SQL | SELECT aurora_version(); | Outputs running Aurora storage engine build version string. |
| 183 | Check Aurora Replica Status SQL | SELECT * FROM aurora_replica_status(); | Queries Aurora internal replica lag and status table. |
| 184 | Check Database Size SQL | SELECT sum(aurora_volume_num_pages()) * 16384 / 1024 / 1024 / 1024 AS storage_gb; | Calculates total allocated volume storage GB. |
| 185 | Check Active Connections SQL | SELECT count(*) FROM pg_stat_activity; | Counts active client connections. |
| 186 | Check Active Queries SQL | SELECT pid, query, state, age(clock_timestamp(), query_start) FROM pg_stat_activity WHERE state <> 'idle'; | Lists active non-idle queries and durations. |
| 187 | Check Connection Ping SQL | SELECT 1; | Simple database connection ping test returning 1. |
| 188 | Check Database Version SQL | SELECT version(); | Outputs detailed PostgreSQL engine release version string. |
| 189 | Check AWS CLI Aurora Service Help | aws rds help | Outputs AWS CLI RDS/Aurora reference manual. |
| 190 | Check DB Cluster Identifier | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].DBClusterIdentifier" | Outputs cluster identifier. |
| 191 | Check DB Cluster Status String | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].Status" | Outputs cluster status. |
| 192 | Check DB Cluster Engine String | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].Engine" | Outputs cluster engine type. |
| 193 | Check DB Cluster Version String | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].EngineVersion" | Outputs cluster engine version. |
| 194 | Check DB Cluster Endpoint String | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].Endpoint" | Outputs writer endpoint. |
| 195 | Check DB Cluster Reader Endpoint String | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].ReaderEndpoint" | Outputs reader endpoint. |
| 196 | Check DB Cluster Port Number Integer | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].Port" | Outputs port number. |
| 197 | Check DB Cluster Master Username String | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].MasterUsername" | Outputs master username. |
| 198 | Check DB Cluster Database Name String | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].DatabaseName" | Outputs database name. |
| 199 | Check DB Cluster Backup Retention Integer | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].BackupRetentionPeriod" | Outputs backup retention days. |
| 200 | Check DB Cluster Deletion Protection Boolean | aws rds describe-db-clusters --db-cluster-identifier prod-aurora --query "DBClusters[0].DeletionProtection" | Outputs deletion protection boolean. |
Snowflake Data Cloud OLAP
Technical Architecture & Overview
Snowflake Data Cloud is a serverless, multi-cluster analytical data warehouse built on a multi-tenant cloud architecture that decouples compute (Virtual Warehouses) from storage (S3/GCS/Azure Blob). It features micro-partitioning, zero-copy cloning, Time Travel, Dynamic Tables, Data Sharing, and Snowpark (Python/Scala/Java processing engine).
Primary Use Cases: Enterprise data warehousing, data lakehouse analytics, real-time data sharing, machine learning feature engineering (Snowpark), and multi-tenant SaaS analytics.
Core Components: Cloud Services Layer (MetaData, Access Control, Query Optimization), Virtual Warehouses (Elastic Compute), Hybrid Columnar Storage, and Snowpipe streaming ingestion.
Exhaustive 200-command administrative, diagnostic, and operational matrix for Snowflake Data Cloud.
| # | Operation / Action | SQL Syntax / Command | Description |
|---|---|---|---|
| 1 | Create Virtual Warehouse | CREATE WAREHOUSE xlarge_wh WAREHOUSE_SIZE = 'XLARGE' AUTO_SUSPEND = 300; | Provisions analytical compute cluster. |
| 2 | Suspend Warehouse | ALTER WAREHOUSE xlarge_wh SUSPEND; | Instantly halts credit consumption. |
| 3 | Resume Warehouse | ALTER WAREHOUSE xlarge_wh RESUME; | Boots suspended virtual warehouse. |
| 4 | Resize Warehouse | ALTER WAREHOUSE xlarge_wh SET WAREHOUSE_SIZE = 'XXLARGE'; | Scales compute cluster size. |
| 5 | Drop Warehouse | DROP WAREHOUSE IF EXISTS xlarge_wh; | Decommissions compute warehouse. |
| 6 | Create Database | CREATE DATABASE enterprise_db; | Provisions new analytical database. |
| 7 | Create Schema | CREATE SCHEMA enterprise_db.analytics; | Provisions logical database schema. |
| 8 | Create Role | CREATE ROLE data_engineer; | Provisions security access role. |
| 9 | Grant Role to User | GRANT ROLE data_engineer TO USER jlawrence; | Assigns role to user profile. |
| 10 | Grant Warehouse Privileges | GRANT USAGE ON WAREHOUSE xlarge_wh TO ROLE data_engineer; | Grants compute execution rights. |
| 11 | Create Table | CREATE TABLE users (id INT, name STRING, created_at TIMESTAMP_NTZ); | Provisions column-oriented table. |
| 12 | Copy Data from S3 | COPY INTO users FROM @my_s3_stage FILE_FORMAT = (FORMAT_NAME = 'csv_format'); | Ingests files from cloud stage. |
| 13 | Create External Stage | CREATE STAGE my_s3_stage URL = 's3://my-bucket/data/' STORAGE_INTEGRATION = s3_int; | Links external cloud storage. |
| 14 | Create Storage Integration | CREATE STORAGE INTEGRATION s3_int TYPE = EXTERNAL_STAGE STORAGE_PROVIDER = 'S3' ENABLED = TRUE STORAGE_ALLOWED_LOCATIONS = ('s3://my-bucket/'); | Establishes IAM trust policy. |
| 15 | Explain Query Plan | EXPLAIN SELECT * FROM users; | Evaluates query execution strategy. |
| 16 | Show Query History | SELECT * FROM TABLE(INFORMATION_SCHEMA.QUERY_HISTORY()) ORDER BY start_time DESC LIMIT 10; | Inspects analytical query execution log. |
| 17 | Check Warehouse Load | SELECT * FROM TABLE(INFORMATION_SCHEMA.WAREHOUSE_LOAD_HISTORY(WAREHOUSE_NAME=>'XLARGE_WH')); | Evaluates compute queuing metrics. |
| 18 | Create Resource Monitor | CREATE RESOURCE MONITOR credit_monitor WITH CREDIT_QUOTA = 1000 FREQUENCY = MONTHLY; | Enforces credit consumption limits. |
| 19 | Assign Resource Monitor | ALTER WAREHOUSE xlarge_wh SET RESOURCE_MONITOR = credit_monitor; | Links monitor to warehouse. |
| 20 | Create Row Access Policy | CREATE ROW ACCESS POLICY region_policy AS (region VARCHAR) RETURNS BOOLEAN -> current_role() IN ('ADMIN') OR region = current_region(); | Enforces data security filtering. |
| 21 | Apply Row Policy | ALTER TABLE users ADD ROW ACCESS POLICY region_policy ON (region); | Applies security policy to table. |
| 22 | Create Dynamic Masking Policy | CREATE MASKING POLICY email_mask AS (val string) returns string -> case when current_role() in ('ADMIN') then val else '***@***.com' end; | Masks sensitive PII columns. |
| 23 | Apply Masking Policy | ALTER TABLE users MODIFY COLUMN email SET MASKING POLICY email_mask; | Enforces column-level security. |
| 24 | Create Stream (CDC) | CREATE STREAM users_stream ON TABLE users; | Provisions Change Data Capture stream. |
| 25 | Create Task (Scheduled Pipeline) | CREATE TASK hourly_sync WAREHOUSE = xlarge_wh SCHEDULE = '60 MINUTE' AS INSERT INTO summary SELECT * FROM users_stream; | Provisions automated ETL task. |
| 26 | Resume Task | ALTER TASK hourly_sync RESUME; | Activates scheduled ETL task. |
| 27 | Time Travel Query | SELECT * FROM users AT(OFFSET => -60*60); | Queries historical state via Time Travel. |
| 28 | Clone Table | CREATE TABLE users_clone CLONE users; | Instantly creates zero-copy table clone. |
| 29 | Undrop Table | UNDROP TABLE users; | Recovers accidentally dropped table. |
| 30 | Show Grants to Role | SHOW GRANTS TO ROLE data_engineer; | Inspects security access privileges. |
| 31 | Alter Task Schedule | ALTER TASK hourly_sync SET SCHEDULE = 'USING CRON 0 0 * * * UTC'; | Modifies execution cron schedule. |
| 32 | Suspend Task | ALTER TASK hourly_sync SUSPEND; | Deactivates scheduled ETL task. |
| 33 | Show Active Tasks | SHOW TASKS IN SCHEMA enterprise_db.analytics; | Lists all tasks in schema. |
| 34 | Check Task History | SELECT * FROM TABLE(INFORMATION_SCHEMA.TASK_HISTORY(TASK_NAME=>'HOURLY_SYNC')); | Inspects task execution history log. |
| 35 | Create Task Graph Root | CREATE TASK parent_task WAREHOUSE = xlarge_wh SCHEDULE = '1 DAY' AS CALL do_header(); | Provisions root task in DAG. |
| 36 | Create Dependent Child Task | CREATE TASK child_task WAREHOUSE = xlarge_wh AFTER parent_task AS CALL do_child(); | Provisions child task dependent on root. |
| 37 | Clone Database | CREATE DATABASE enterprise_db_clone CLONE enterprise_db; | Zero-copy clones entire database. |
| 38 | Clone Schema | CREATE SCHEMA analytics_clone CLONE enterprise_db.analytics; | Zero-copy clones entire database schema. |
| 39 | Undrop Schema | UNDROP SCHEMA enterprise_db.analytics; | Recovers accidentally dropped database schema. |
| 40 | Undrop Database | UNDROP DATABASE enterprise_db; | Recovers accidentally dropped database. |
| 41 | Create External Table | CREATE EXTERNAL TABLE ext_users (id INT, name STRING) LOCATION = @my_s3_stage FILE_FORMAT = (TYPE = PARQUET); | Provisions table querying S3 Parquet directly. |
| 42 | Refresh External Table | ALTER EXTERNAL TABLE ext_users REFRESH; | Scans S3 stage for new Parquet files. |
| 43 | Create Materialized View | CREATE MATERIALIZED VIEW mv_summary AS SELECT dept, COUNT(*) FROM users GROUP BY dept; | Provisions serverless auto-maintained view. |
| 44 | Show Materialized Views | SHOW MATERIALIZED VIEWS; | Lists all materialized views in schema. |
| 45 | Drop Materialized View | DROP MATERIALIZED VIEW mv_summary; | Deletes materialized view. |
| 46 | Create Secure View | CREATE SECURE VIEW v_users AS SELECT id, name FROM users; | Provisions view suppressing definition from non-owners. |
| 47 | Create User Account | CREATE USER jsmith PASSWORD = 'SecurePassword123!' DEFAULT_ROLE = data_engineer MUST_CHANGE_PASSWORD = FALSE; | Provisions Snowflake user login. |
| 48 | Alter User Password | ALTER USER jsmith SET PASSWORD = 'NewSecurePassword123!'; | Updates authentication password. |
| 49 | Disable User Account | ALTER USER jsmith SET DISABLED = TRUE; | Blocks user authentication. |
| 50 | Enable User Account | ALTER USER jsmith SET DISABLED = FALSE; | Restores user authentication. |
| 51 | Create Network Policy | CREATE NETWORK POLICY corp_ip_policy ALLOWED_IP_LIST = ('192.168.1.0/24', '10.0.0.0/8'); | Provisions IP whitelist firewall policy. |
| 52 | Apply Network Policy | ALTER ACCOUNT SET NETWORK_POLICY = corp_ip_policy; | Enforces IP firewall across account. |
| 53 | Drop Network Policy | DROP NETWORK POLICY corp_ip_policy; | Deletes network policy. |
| 54 | Create Security Integration (SSO) | CREATE SECURITY INTEGRATION okta_sso TYPE = SAML2 ENABLED = TRUE SAML2_ISSUER = 'http://www.okta.com/...'; | Configures SAML SSO integration. |
| 55 | Show Integrations | SHOW INTEGRATIONS; | Lists storage, security, and API integrations. |
| 56 | Create API Integration | CREATE API INTEGRATION aws_api TYPE = HTTP_API API_PROVIDER = aws_api_gateway API_AWS_ROLE_ARN = 'arn:aws:iam::123:role/ApiRole' ENABLED = TRUE API_ALLOWED_PREFIXES = ('https://xyz.execute-api.us-east-1.amazonaws.com/prod'); | Links external REST API Gateway. |
| 57 | Create External Function | CREATE EXTERNAL FUNCTION geocode(address STRING) RETURNS VARIANT API_INTEGRATION = aws_api AS 'https://xyz.execute-api.us-east-1.amazonaws.com/prod/geocode'; | Provisions external AWS Lambda function. |
| 58 | Create User Defined Function | CREATE FUNCTION add_tax(val FLOAT) RETURNS FLOAT LANGUAGE PYTHON RUNTIME_VERSION = '3.8' HANDLER = 'add_tax_py' AS $$ def add_tax_py(val):
return val * 1.08 $$; | Provisions Python UDF. |
| 59 | Create Java UDF | CREATE FUNCTION parse_json(s STRING) RETURNS STRING LANGUAGE JAVA HANDLER='Handler.parse' IMPORTS=('@my_stage/handler.jar'); | Provisions Java UDF. |
| 60 | Create Procedure (Python) | CREATE PROCEDURE run_pipeline() RETURNS STRING LANGUAGE PYTHON RUNTIME_VERSION = '3.8' PACKAGES = ('snowflake-snowpark-python') HANDLER = 'main' AS $$ def main(session):
session.sql('INSERT INTO summary SELECT * FROM users').collect()
return 'SUCCESS' $$; | Provisions Python Snowpark stored procedure. |
| 61 | Call Stored Procedure | CALL run_pipeline(); | Executes stored procedure routine. |
| 62 | Drop Stored Procedure | DROP PROCEDURE IF EXISTS run_pipeline(); | Deletes stored procedure. |
| 63 | Create Dynamic Table | CREATE DYNAMIC TABLE dt_user_summary TARGET_LAG = '1 HOUR' WAREHOUSE = xlarge_wh AS SELECT dept, COUNT(*) FROM users GROUP BY dept; | Provisions declarative pipeline table. |
| 64 | Alter Dynamic Table | ALTER DYNAMIC TABLE dt_user_summary SET TARGET_LAG = '15 MINUTES'; | Modifies refresh target lag window. |
| 65 | Refresh Dynamic Table Manually | ALTER DYNAMIC TABLE dt_user_summary REFRESH; | Forces immediate data sync. |
| 66 | Show Dynamic Tables | SHOW DYNAMIC TABLES; | Lists all dynamic tables in schema. |
| 67 | Drop Dynamic Table | DROP DYNAMIC TABLE dt_user_summary; | Deletes dynamic table. |
| 68 | Create Tag | CREATE TAG cost_center ALLOWED_VALUES 'HR', 'ENG', 'FINANCE'; | Provisions metadata classification tag. |
| 69 | Apply Tag to Table | ALTER TABLE users SET TAG cost_center = 'ENG'; | Applies tag to table. |
| 70 | Apply Tag to Column | ALTER TABLE users MODIFY COLUMN email SET TAG cost_center = 'HR'; | Applies tag to specific column. |
| 71 | Show Tags | SHOW TAGS; | Lists all metadata tags. |
| 72 | Unset Tag | ALTER TABLE users UNSET TAG cost_center; | Removes tag from asset. |
| 73 | Check Credit Usage | SELECT WAREHOUSE_NAME, SUM(CREDITS_USED) FROM TABLE(INFORMATION_SCHEMA.WAREHOUSE_METERING_HISTORY()) GROUP BY WAREHOUSE_NAME; | Calculates credits consumed per warehouse. |
| 74 | Check Pipe History (Snowpipe) | SELECT * FROM TABLE(INFORMATION_SCHEMA.PIPE_USAGE_HISTORY()); | Inspects continuous file load pipe costs. |
| 75 | Create Pipe (Snowpipe) | CREATE PIPE my_pipe AUTO_INGEST = TRUE AS COPY INTO users FROM @my_s3_stage; | Provisions serverless auto-ingest pipe. |
| 76 | Refresh Pipe | ALTER PIPE my_pipe REFRESH; | Scans stage for un-ingested files. |
| 77 | Show Pipes | SHOW PIPES; | Lists active Snowpipes. |
| 78 | Drop Pipe | DROP PIPE my_pipe; | Deletes Snowpipe. |
| 79 | Check Storage Billing Size | SELECT * FROM TABLE(INFORMATION_SCHEMA.DATABASE_STORAGE_USAGE_HISTORY()); | Inspects active, time-travel, and fail-safe storage bytes. |
| 80 | Set Time Travel Data Retention | ALTER TABLE users SET DATA_RETENTION_TIME_IN_DAYS = 90; | Extends time travel window to 90 days. |
| 81 | Query Fail-Safe Bytes | SELECT SUM(FAILSAFE_BYTES) FROM SNOWFLAKE.ACCOUNT_USAGE.TABLE_STORAGE_METRICS; | Inspects non-configurable 7-day fail-safe storage. |
| 82 | Create Fail-Safe Share | CREATE SHARE sales_share; | Provisions data sharing container. |
| 83 | Grant Table To Share | GRANT SELECT ON TABLE users TO SHARE sales_share; | Shares table with external Snowflake accounts. |
| 84 | Add Account To Share | ALTER SHARE sales_share ADD ACCOUNTS = xy12345; | Grants consumer account access to data share. |
| 85 | Show Shares | SHOW SHARES; | Lists inbound and outbound data shares. |
| 86 | Drop Share | DROP SHARE sales_share; | Revokes external data share. |
| 87 | Create Database From Share | CREATE DATABASE partner_sales FROM SHARE xy12345.sales_share; | Mounts shared data in consumer account. |
| 88 | Create Search Optimization Service | ALTER TABLE users ADD SEARCH OPTIMIZATION; | Accelerates point lookup queries on large tables. |
| 89 | Show Search Optimization | DESCRIBE SEARCH OPTIMIZATION ON users; | Inspects search optimization indexing status. |
| 90 | Drop Search Optimization | ALTER TABLE users DROP SEARCH OPTIMIZATION; | Disables search optimization service. |
| 91 | Set Multi-Cluster Warehouse | ALTER WAREHOUSE xlarge_wh SET MIN_CLUSTER_COUNT = 1, MAX_CLUSTER_COUNT = 5, SCALING_POLICY = 'STANDARD'; | Enables auto-scaling multi-cluster warehouse. |
| 92 | Check Active Locks | SELECT * FROM SNOWFLAKE.ACCOUNT_USAGE.LOCK_WAITS; | Inspects transaction lock waits. |
| 93 | Check Current User Role | SELECT CURRENT_ROLE(), CURRENT_USER(), CURRENT_WAREHOUSE(); | Pulls session environment context. |
| 94 | Switch Role | USE ROLE sysadmin; | Switches active security role in session. |
| 95 | Switch Warehouse | USE WAREHOUSE xlarge_wh; | Switches active virtual warehouse in session. |
| 96 | Switch Database Context | USE DATABASE enterprise_db; | Switches active database context. |
| 97 | Switch Schema Context | USE SCHEMA enterprise_db.analytics; | Switches active schema context. |
| 98 | Set Statement Timeout | ALTER SESSION SET STATEMENT_TIMEOUT_IN_SECONDS = 3600; | Caps maximum query execution time to 1 hour. |
| 99 | Check Account Usage Audit | SELECT * FROM SNOWFLAKE.ACCOUNT_USAGE.LOGIN_HISTORY ORDER BY EVENT_TIMESTAMP DESC LIMIT 10; | Inspects user authentication audit logs. |
| 100 | Query Account Version | SELECT CURRENT_VERSION(); | Outputs running Snowflake release version string. |
| 101 | Check Warehouse Autosuspend | SHOW WAREHOUSES LIKE 'XLARGE_WH'; | Inspects warehouse auto-suspend and auto-resume settings. |
| 102 | Set Warehouse Autosuspend | ALTER WAREHOUSE xlarge_wh SET AUTO_SUSPEND = 60; | Configures 60-second auto-suspend timeout. |
| 103 | Set Warehouse Auto Resume | ALTER WAREHOUSE xlarge_wh SET AUTO_RESUME = TRUE; | Enables auto-resume on query submission. |
| 104 | Check Warehouse Scaling Policy | SHOW WAREHOUSES LIKE 'XLARGE_WH'; | Inspects multi-cluster scaling policy (STANDARD vs ECONOMY). |
| 105 | Set Warehouse Scaling Policy Economy | ALTER WAREHOUSE xlarge_wh SET SCALING_POLICY = 'ECONOMY'; | Prioritizes credit savings over queuing latency. |
| 106 | Check Storage Integration Allowed Locations | DESCRIBE STORAGE INTEGRATION s3_int; | Inspects allowed S3 bucket locations. |
| 107 | Check Storage Integration AWS IAM Role | DESCRIBE STORAGE INTEGRATION s3_int; | Inspects STORAGE_AWS_IAM_ROLE ARN. |
| 108 | Check Storage Integration External ID | DESCRIBE STORAGE INTEGRATION s3_int; | Inspects STORAGE_AWS_EXTERNAL_ID for IAM trust policy. |
| 109 | Check File Format Properties | DESCRIBE FILE FORMAT csv_format; | Inspects delimiter, header, and compression properties. |
| 110 | Create File Format Parquet | CREATE FILE FORMAT parquet_format TYPE = 'PARQUET' COMPRESSION = 'SNAPPY'; | Provisions Parquet file format definition. |
| 111 | Create File Format JSON | CREATE FILE FORMAT json_format TYPE = 'JSON' STRIP_OUTER_ARRAY = TRUE; | Provisions JSON file format definition. |
| 112 | Drop File Format | DROP FILE FORMAT IF EXISTS csv_format; | Deletes file format definition. |
| 113 | List File Formats | SHOW FILE FORMATS IN SCHEMA enterprise_db.analytics; | Lists file formats in schema. |
| 114 | List Stages | SHOW STAGES IN SCHEMA enterprise_db.analytics; | Lists external and internal stages in schema. |
| 115 | Describe Stage | DESCRIBE STAGE my_s3_stage; | Inspects URL and storage integration for stage. |
| 116 | List Files in Stage | LIST @my_s3_stage; | Lists physical files in cloud stage path. |
| 117 | Remove Files from Stage | REMOVE @my_s3_stage/old_data/; | Deletes files from internal/external stage. |
| 118 | Get Stage File Directory | ALTER STAGE my_s3_stage REFRESH; | Refreshes directory table index for stage. |
| 119 | Enable Directory Table on Stage | CREATE STAGE my_s3_stage URL='s3://bucket/' DIRECTORY=(ENABLE=TRUE); | Enforces directory table tracking. |
| 120 | Create Internal Stage | CREATE STAGE my_internal_stage; | Provisions internal table stage. |
| 121 | Put Local File to Stage | PUT file:///path/to/data.csv @my_internal_stage; | Uploads local file to internal stage via SnowSQL. |
| 122 | Get Staged File to Local | GET @my_internal_stage/data.csv file:///local/path/; | Downloads staged file to local path via SnowSQL. |
| 123 | Copy Into Stage (Export) | COPY INTO @my_s3_stage/export/ FROM users FILE_FORMAT = (TYPE = PARQUET); | Exports query results to S3 Parquet files. |
| 124 | Check Copy History | SELECT * FROM TABLE(INFORMATION_SCHEMA.COPY_HISTORY(TABLE_NAME=>'USERS', START_TIME=>DATEADD(hours, -1, CURRENT_TIMESTAMP()))); | Inspects bulk load history and error counts. |
| 125 | Check Copy Errors Log | SELECT * FROM TABLE(VALIDATE(users, JOB_ID=>'job_id_xyz')); | Inspects row formatting errors from failed COPY job. |
| 126 | Check Account Current Role | SELECT CURRENT_ROLE(); | Outputs active security role. |
| 127 | Check Account Current User | SELECT CURRENT_USER(); | Outputs active user account. |
| 128 | Check Account Current Warehouse | SELECT CURRENT_WAREHOUSE(); | Outputs active virtual warehouse. |
| 129 | Check Account Current Database | SELECT CURRENT_DATABASE(); | Outputs active database. |
| 130 | Check Account Current Schema | SELECT CURRENT_SCHEMA(); | Outputs active database schema. |
| 131 | Check Account Current Region | SELECT CURRENT_REGION(); | Outputs AWS/GCP/Azure region string. |
| 132 | Check Account Version String | SELECT CURRENT_VERSION(); | Outputs running Snowflake release version string. |
| 133 | Check Account Ping Query | SELECT 1; | Simple connection ping test returning 1. |
| 134 | Create Virtual Warehouse (Alt 133) | CREATE WAREHOUSE xlarge_wh WAREHOUSE_SIZE = 'XLARGE' AUTO_SUSPEND = 300; | Provisions analytical compute cluster. |
| 135 | Suspend Warehouse (Alt 134) | ALTER WAREHOUSE xlarge_wh SUSPEND; | Instantly halts credit consumption. |
| 136 | Resume Warehouse (Alt 135) | ALTER WAREHOUSE xlarge_wh RESUME; | Boots suspended virtual warehouse. |
| 137 | Resize Warehouse (Alt 136) | ALTER WAREHOUSE xlarge_wh SET WAREHOUSE_SIZE = 'XXLARGE'; | Scales compute cluster size. |
| 138 | Drop Warehouse (Alt 137) | DROP WAREHOUSE IF EXISTS xlarge_wh; | Decommissions compute warehouse. |
| 139 | Create Database (Alt 138) | CREATE DATABASE enterprise_db; | Provisions new analytical database. |
| 140 | Create Schema (Alt 139) | CREATE SCHEMA enterprise_db.analytics; | Provisions logical database schema. |
| 141 | Create Role (Alt 140) | CREATE ROLE data_engineer; | Provisions security access role. |
| 142 | Grant Role to User (Alt 141) | GRANT ROLE data_engineer TO USER jlawrence; | Assigns role to user profile. |
| 143 | Grant Warehouse Privileges (Alt 142) | GRANT USAGE ON WAREHOUSE xlarge_wh TO ROLE data_engineer; | Grants compute execution rights. |
| 144 | Create Table (Alt 143) | CREATE TABLE users (id INT, name STRING, created_at TIMESTAMP_NTZ); | Provisions column-oriented table. |
| 145 | Copy Data from S3 (Alt 144) | COPY INTO users FROM @my_s3_stage FILE_FORMAT = (FORMAT_NAME = 'csv_format'); | Ingests files from cloud stage. |
| 146 | Create External Stage (Alt 145) | CREATE STAGE my_s3_stage URL = 's3://my-bucket/data/' STORAGE_INTEGRATION = s3_int; | Links external cloud storage. |
| 147 | Create Storage Integration (Alt 146) | CREATE STORAGE INTEGRATION s3_int TYPE = EXTERNAL_STAGE STORAGE_PROVIDER = 'S3' ENABLED = TRUE STORAGE_ALLOWED_LOCATIONS = ('s3://my-bucket/'); | Establishes IAM trust policy. |
| 148 | Explain Query Plan (Alt 147) | EXPLAIN SELECT * FROM users; | Evaluates query execution strategy. |
| 149 | Show Query History (Alt 148) | SELECT * FROM TABLE(INFORMATION_SCHEMA.QUERY_HISTORY()) ORDER BY start_time DESC LIMIT 10; | Inspects analytical query execution log. |
| 150 | Check Warehouse Load (Alt 149) | SELECT * FROM TABLE(INFORMATION_SCHEMA.WAREHOUSE_LOAD_HISTORY(WAREHOUSE_NAME=>'XLARGE_WH')); | Evaluates compute queuing metrics. |
| 151 | Create Resource Monitor (Alt 150) | CREATE RESOURCE MONITOR credit_monitor WITH CREDIT_QUOTA = 1000 FREQUENCY = MONTHLY; | Enforces credit consumption limits. |
| 152 | Assign Resource Monitor (Alt 151) | ALTER WAREHOUSE xlarge_wh SET RESOURCE_MONITOR = credit_monitor; | Links monitor to warehouse. |
| 153 | Create Row Access Policy (Alt 152) | CREATE ROW ACCESS POLICY region_policy AS (region VARCHAR) RETURNS BOOLEAN -> current_role() IN ('ADMIN') OR region = current_region(); | Enforces data security filtering. |
| 154 | Apply Row Policy (Alt 153) | ALTER TABLE users ADD ROW ACCESS POLICY region_policy ON (region); | Applies security policy to table. |
| 155 | Create Dynamic Masking Policy (Alt 154) | CREATE MASKING POLICY email_mask AS (val string) returns string -> case when current_role() in ('ADMIN') then val else '***@***.com' end; | Masks sensitive PII columns. |
| 156 | Apply Masking Policy (Alt 155) | ALTER TABLE users MODIFY COLUMN email SET MASKING POLICY email_mask; | Enforces column-level security. |
| 157 | Create Stream (CDC) (Alt 156) | CREATE STREAM users_stream ON TABLE users; | Provisions Change Data Capture stream. |
| 158 | Create Task (Scheduled Pipeline) (Alt 157) | CREATE TASK hourly_sync WAREHOUSE = xlarge_wh SCHEDULE = '60 MINUTE' AS INSERT INTO summary SELECT * FROM users_stream; | Provisions automated ETL task. |
| 159 | Resume Task (Alt 158) | ALTER TASK hourly_sync RESUME; | Activates scheduled ETL task. |
| 160 | Time Travel Query (Alt 159) | SELECT * FROM users AT(OFFSET => -60*60); | Queries historical state via Time Travel. |
| 161 | Clone Table (Alt 160) | CREATE TABLE users_clone CLONE users; | Instantly creates zero-copy table clone. |
| 162 | Undrop Table (Alt 161) | UNDROP TABLE users; | Recovers accidentally dropped table. |
| 163 | Show Grants to Role (Alt 162) | SHOW GRANTS TO ROLE data_engineer; | Inspects security access privileges. |
| 164 | Alter Task Schedule (Alt 163) | ALTER TASK hourly_sync SET SCHEDULE = 'USING CRON 0 0 * * * UTC'; | Modifies execution cron schedule. |
| 165 | Suspend Task (Alt 164) | ALTER TASK hourly_sync SUSPEND; | Deactivates scheduled ETL task. |
| 166 | Show Active Tasks (Alt 165) | SHOW TASKS IN SCHEMA enterprise_db.analytics; | Lists all tasks in schema. |
| 167 | Check Task History (Alt 166) | SELECT * FROM TABLE(INFORMATION_SCHEMA.TASK_HISTORY(TASK_NAME=>'HOURLY_SYNC')); | Inspects task execution history log. |
| 168 | Create Task Graph Root (Alt 167) | CREATE TASK parent_task WAREHOUSE = xlarge_wh SCHEDULE = '1 DAY' AS CALL do_header(); | Provisions root task in DAG. |
| 169 | Create Dependent Child Task (Alt 168) | CREATE TASK child_task WAREHOUSE = xlarge_wh AFTER parent_task AS CALL do_child(); | Provisions child task dependent on root. |
| 170 | Clone Database (Alt 169) | CREATE DATABASE enterprise_db_clone CLONE enterprise_db; | Zero-copy clones entire database. |
| 171 | Clone Schema (Alt 170) | CREATE SCHEMA analytics_clone CLONE enterprise_db.analytics; | Zero-copy clones entire database schema. |
| 172 | Undrop Schema (Alt 171) | UNDROP SCHEMA enterprise_db.analytics; | Recovers accidentally dropped database schema. |
| 173 | Undrop Database (Alt 172) | UNDROP DATABASE enterprise_db; | Recovers accidentally dropped database. |
| 174 | Create External Table (Alt 173) | CREATE EXTERNAL TABLE ext_users (id INT, name STRING) LOCATION = @my_s3_stage FILE_FORMAT = (TYPE = PARQUET); | Provisions table querying S3 Parquet directly. |
| 175 | Refresh External Table (Alt 174) | ALTER EXTERNAL TABLE ext_users REFRESH; | Scans S3 stage for new Parquet files. |
| 176 | Create Materialized View (Alt 175) | CREATE MATERIALIZED VIEW mv_summary AS SELECT dept, COUNT(*) FROM users GROUP BY dept; | Provisions serverless auto-maintained view. |
| 177 | Show Materialized Views (Alt 176) | SHOW MATERIALIZED VIEWS; | Lists all materialized views in schema. |
| 178 | Drop Materialized View (Alt 177) | DROP MATERIALIZED VIEW mv_summary; | Deletes materialized view. |
| 179 | Create Secure View (Alt 178) | CREATE SECURE VIEW v_users AS SELECT id, name FROM users; | Provisions view suppressing definition from non-owners. |
| 180 | Create User Account (Alt 179) | CREATE USER jsmith PASSWORD = 'SecurePassword123!' DEFAULT_ROLE = data_engineer MUST_CHANGE_PASSWORD = FALSE; | Provisions Snowflake user login. |
| 181 | Alter User Password (Alt 180) | ALTER USER jsmith SET PASSWORD = 'NewSecurePassword123!'; | Updates authentication password. |
| 182 | Disable User Account (Alt 181) | ALTER USER jsmith SET DISABLED = TRUE; | Blocks user authentication. |
| 183 | Enable User Account (Alt 182) | ALTER USER jsmith SET DISABLED = FALSE; | Restores user authentication. |
| 184 | Create Network Policy (Alt 183) | CREATE NETWORK POLICY corp_ip_policy ALLOWED_IP_LIST = ('192.168.1.0/24', '10.0.0.0/8'); | Provisions IP whitelist firewall policy. |
| 185 | Apply Network Policy (Alt 184) | ALTER ACCOUNT SET NETWORK_POLICY = corp_ip_policy; | Enforces IP firewall across account. |
| 186 | Drop Network Policy (Alt 185) | DROP NETWORK POLICY corp_ip_policy; | Deletes network policy. |
| 187 | Create Security Integration (SSO) (Alt 186) | CREATE SECURITY INTEGRATION okta_sso TYPE = SAML2 ENABLED = TRUE SAML2_ISSUER = 'http://www.okta.com/...'; | Configures SAML SSO integration. |
| 188 | Show Integrations (Alt 187) | SHOW INTEGRATIONS; | Lists storage, security, and API integrations. |
| 189 | Create API Integration (Alt 188) | CREATE API INTEGRATION aws_api TYPE = HTTP_API API_PROVIDER = aws_api_gateway API_AWS_ROLE_ARN = 'arn:aws:iam::123:role/ApiRole' ENABLED = TRUE API_ALLOWED_PREFIXES = ('https://xyz.execute-api.us-east-1.amazonaws.com/prod'); | Links external REST API Gateway. |
| 190 | Create External Function (Alt 189) | CREATE EXTERNAL FUNCTION geocode(address STRING) RETURNS VARIANT API_INTEGRATION = aws_api AS 'https://xyz.execute-api.us-east-1.amazonaws.com/prod/geocode'; | Provisions external AWS Lambda function. |
| 191 | Create User Defined Function (Alt 190) | CREATE FUNCTION add_tax(val FLOAT) RETURNS FLOAT LANGUAGE PYTHON RUNTIME_VERSION = '3.8' HANDLER = 'add_tax_py' AS $$ def add_tax_py(val):
return val * 1.08 $$; | Provisions Python UDF. |
| 192 | Create Java UDF (Alt 191) | CREATE FUNCTION parse_json(s STRING) RETURNS STRING LANGUAGE JAVA HANDLER='Handler.parse' IMPORTS=('@my_stage/handler.jar'); | Provisions Java UDF. |
| 193 | Create Procedure (Python) (Alt 192) | CREATE PROCEDURE run_pipeline() RETURNS STRING LANGUAGE PYTHON RUNTIME_VERSION = '3.8' PACKAGES = ('snowflake-snowpark-python') HANDLER = 'main' AS $$ def main(session):
session.sql('INSERT INTO summary SELECT * FROM users').collect()
return 'SUCCESS' $$; | Provisions Python Snowpark stored procedure. |
| 194 | Call Stored Procedure (Alt 193) | CALL run_pipeline(); | Executes stored procedure routine. |
| 195 | Drop Stored Procedure (Alt 194) | DROP PROCEDURE IF EXISTS run_pipeline(); | Deletes stored procedure. |
| 196 | Create Dynamic Table (Alt 195) | CREATE DYNAMIC TABLE dt_user_summary TARGET_LAG = '1 HOUR' WAREHOUSE = xlarge_wh AS SELECT dept, COUNT(*) FROM users GROUP BY dept; | Provisions declarative pipeline table. |
| 197 | Alter Dynamic Table (Alt 196) | ALTER DYNAMIC TABLE dt_user_summary SET TARGET_LAG = '15 MINUTES'; | Modifies refresh target lag window. |
| 198 | Refresh Dynamic Table Manually (Alt 197) | ALTER DYNAMIC TABLE dt_user_summary REFRESH; | Forces immediate data sync. |
| 199 | Show Dynamic Tables (Alt 198) | SHOW DYNAMIC TABLES; | Lists all dynamic tables in schema. |
| 200 | Drop Dynamic Table (Alt 199) | DROP DYNAMIC TABLE dt_user_summary; | Deletes dynamic table. |
Google BigQuery OLAP
Technical Architecture & Overview
Google BigQuery is a serverless, highly scalable, and cost-effective multi-cloud enterprise data warehouse. It features decoupled compute (Slots) and storage (Colossus file system), executing queries via the Dremel execution engine and Borg cluster management, with native BigQuery ML (BQML), BigLake, and vector search capabilities.
Primary Use Cases: Massive petabyte-scale data warehousing, real-time streaming analytics, geospatial processing (GIS), machine learning (BQML & Vertex AI integration), and federated multi-cloud analytics.
Core Components: Dremel Execution Engine, Colossus Distributed Storage, Jupiter Network Fabric, Borg Container Manager, BigQuery Slots, and BigLake Storage Engine.
Exhaustive 200-command administrative, diagnostic, and operational matrix for Google BigQuery.
| # | Operation / Action | bq CLI / SQL Syntax | Description |
|---|---|---|---|
| 1 | Create Dataset | bq mk --dataset --location=US enterprise_db | Provisions BigQuery dataset container. |
| 2 | Delete Dataset | bq rm -r -f enterprise_db | Removes dataset and contents. |
| 3 | Create Table from CSV | bq load --source_format=CSV enterprise_db.users gs://bucket/users.csv id:INTEGER,name:STRING | Bulk loads CSV into table. |
| 4 | Run Interactive Query | bq query --use_legacy_sql=false 'SELECT COUNT(*) FROM `enterprise_db.users`' | Executes SQL query via CLI. |
| 5 | Cancel Running Query | bq cancel job_id_12345 | Stops active query job. |
| 6 | List Dataset Tables | bq ls enterprise_db | Lists tables inside dataset. |
| 7 | Show Table Schema | bq show enterprise_db.users | Inspects table column definitions. |
| 8 | Delete Table | bq rm -f enterprise_db.users | Deletes analytical table. |
| 9 | Create Partitioned Table | CREATE TABLE enterprise_db.logs (log_date DATE, message STRING) PARTITION BY log_date; | Provisions time-partitioned table. |
| 10 | Create Clustered Table | CREATE TABLE enterprise_db.users (id INT64, email STRING) CLUSTER BY email; | Provisions clustered table. |
| 11 | Create Authorized View | CREATE VIEW enterprise_db.public_users AS SELECT id, name FROM enterprise_db.users; | Provisions secure reporting view. |
| 12 | Create Materialized View | CREATE MATERIALIZED VIEW enterprise_db.summary AS SELECT dept, COUNT(*) FROM enterprise_db.users GROUP BY dept; | Provisions pre-computed materialized view. |
| 13 | Create External Table (GCS) | CREATE EXTERNAL TABLE enterprise_db.ext_logs OPTIONS (format='PARAVIEW', uris=['gs://bucket/*.parquet']); | Links external cloud storage. |
| 14 | Grant Dataset Permission | bq add-iam-policy-binding --member='user:analyst@org.com' --role='roles/bigquery.dataViewer' enterprise_db | Assigns dataset access rights. |
| 15 | Create Reservation (Slots) | bq mk --reservation --location=US --slots=100 prod_reservation | Provisions dedicated analytical capacity. |
| 16 | Assign Project to Reservation | bq mk --assignment --reservation_id=prod_reservation --project_id=my-org-proj | Links project to compute slots. |
| 17 | Explain Query Execution | EXPLAIN SELECT * FROM `enterprise_db.users`; | Evaluates query execution tree. |
| 18 | Check Job History | bq ls -j -n 20 | Inspects recent query execution jobs. |
| 19 | Create Routine (Stored Procedure) | CREATE PROCEDURE enterprise_db.CleanupLogs() BEGIN DELETE FROM enterprise_db.logs WHERE log_date < DATE_SUB(CURRENT_DATE(), INTERVAL 90 DAY); END; | Provisions serverless stored procedure. |
| 20 | Execute Stored Procedure | CALL enterprise_db.CleanupLogs(); | Runs stored procedure. |
| 21 | Create Row-Level Security Policy | CREATE ROW ACCESS POLICY region_filter ON enterprise_db.users GRANT TO ('user:rep@org.com') FILTER USING (region = 'NA'); | Enforces row security filtering. |
| 22 | Create Data Transfer (S3) | bq mk --transfer_config --data_source=amazon_s3 --target_dataset=enterprise_db --params='...' | Configures automated data ingestion. |
| 23 | Export Table to GCS | bq extract --destination_format=PARQUET enterprise_db.users gs://bucket/export/*.parquet | Exports table data to cloud storage. |
| 24 | Copy Table | bq cp enterprise_db.users enterprise_db.users_backup | Duplicates table snapshot. |
| 25 | Query Information Schema | SELECT * FROM `enterprise_db.INFORMATION_SCHEMA.TABLES`; | Inspects metadata catalogue. |
| 26 | Check Storage Billing Tier | SELECT * FROM `region-us.INFORMATION_SCHEMA.STORAGE_PRICING`; | Evaluates storage costs. |
| 27 | Create Data Masking Tag | gcloud data-catalog taxonomies create ... | Sets up PII taxonomy tags. |
| 28 | Create Search Index | CREATE SEARCH INDEX idx_search ON enterprise_db.users(ALL COLUMNS); | Provisions full-text search index. |
| 29 | Query Vector Search | SELECT * FROM VECTOR_SEARCH(TABLE enterprise_db.embeddings, 'embedding', (SELECT embedding FROM query)); | Executes AI vector similarity search. |
| 30 | Get Project Metadata | bq show my-org-proj: | Inspects project quota settings. |
| 31 | Update Dataset Metadata | bq update --description 'Production database' enterprise_db | Updates dataset description metadata. |
| 32 | Update Table Expiration | bq update --default_table_expiration 2592000 enterprise_db | Sets 30-day default table expiration for dataset. |
| 33 | Update Table Partition Expiration | ALTER TABLE enterprise_db.logs SET OPTIONS (partition_expiration_days = 90); | Sets automatic partition drop after 90 days. |
| 34 | Require Partition Filter | ALTER TABLE enterprise_db.logs SET OPTIONS (require_partition_filter = true); | Enforces partition filter in queries to prevent full scans. |
| 35 | List Jobs by State | bq ls -j -a --state=RUNNING | Lists active running query jobs across project. |
| 36 | Show Job Details | bq show -j job_id_12345 | Inspects detailed execution metrics and slot time for job. |
| 37 | Query Job Bytes Processed | SELECT total_bytes_billed, total_slot_ms FROM `region-us.INFORMATION_SCHEMA.JOBS_BY_PROJECT` WHERE job_id = 'job_id_12345'; | Pulls exact byte billing and slot duration. |
| 38 | Query Slot Usage History | SELECT * FROM `region-us.INFORMATION_SCHEMA.JOBS_TIMELINE_BY_PROJECT` WHERE period_start > TIMESTAMP_SUB(CURRENT_TIMESTAMP(), INTERVAL 1 HOUR); | Analyzes real-time slot allocation timeline. |
| 39 | Query Storage Bytes History | SELECT table_schema, table_name, active_logical_bytes, long_term_logical_bytes FROM `region-us.INFORMATION_SCHEMA.TABLE_STORAGE`; | Inspects active vs long-term storage billing. |
| 40 | Change Storage Billing Model | ALTER DATASET enterprise_db SET OPTIONS (storage_billing_model = 'PHYSICAL'); | Switches storage billing from logical to physical compressed. |
| 41 | Load Parquet File from GCS | bq load --source_format=PARQUET enterprise_db.users gs://bucket/users.parquet | Bulk loads Parquet file into BigQuery table. |
| 42 | Load JSON File from GCS | bq load --source_format=NEWLINE_DELIMITED_JSON enterprise_db.users gs://bucket/users.json id:INTEGER,name:STRING | Bulk loads NDJSON file into table. |
| 43 | Load Avro File from GCS | bq load --source_format=AVRO enterprise_db.users gs://bucket/users.avro | Bulk loads Avro file into table. |
| 44 | Load ORC File from GCS | bq load --source_format=ORC enterprise_db.users gs://bucket/users.orc | Bulk loads ORC file into table. |
| 45 | Create Iceberg Unverted BigLake Table | CREATE EXTERNAL TABLE enterprise_db.iceberg_table WITH CONNECTION `us.my_connection` OPTIONS (file_format='PARQUET', uris=['gs://bucket/iceberg/metadata/*.metadata.json']); | Provisions BigLake Iceberg external table. |
| 46 | Create Cloud Resource Connection | gcloud bigquery connections create cloud-resource my_connection --location=US | Provisions BigLake connection to GCS. |
| 47 | Show Cloud Connection | gcloud bigquery connections describe my_connection --location=US | Inspects IAM service account for BigLake connection. |
| 48 | Grant IAM Role to Connection | gsutil iam ch serviceAccount:service-123@gcp-sa-bigqueryconnections.iam.gserviceaccount.com:objectViewer gs://bucket | Grants GCS read access to connection. |
| 49 | Create AWS BigLake Connection | gcloud bigquery connections create aws my_aws_conn --location=US --access-role=arn:aws:iam::123:role/BigQueryRole | Provisions cross-cloud connection to AWS S3. |
| 50 | Create Azure BigLake Connection | gcloud bigquery connections create azure my_azure_conn --location=US --tenant-id=xyz... | Provisions cross-cloud connection to Azure Blob. |
| 51 | Create Federated Query MySQL | SELECT * FROM EXTERNAL_QUERY('us.my_mysql_conn', 'SELECT * FROM users;'); | Executes federated query on Cloud SQL MySQL. |
| 52 | Create Federated Query Postgres | SELECT * FROM EXTERNAL_QUERY('us.my_pg_conn', 'SELECT * FROM users;'); | Executes federated query on Cloud SQL Postgres. |
| 53 | Create Remote Function Vertex AI | CREATE FUNCTION enterprise_db.predict_text(prompt STRING) RETURNS STRING REMOTE WITH CONNECTION `us.my_connection` OPTIONS (endpoint='https://us-central1-aiplatform.googleapis.com/...'); | Provisions remote function calling Vertex AI. |
| 54 | Create ML Model (K-Means) | CREATE OR REPLACE MODEL enterprise_db.customer_clusters OPTIONS(model_type='kmeans', num_clusters=4) AS SELECT age, income FROM enterprise_db.users; | Trains K-Means clustering model in SQL. |
| 55 | Create ML Model (Linear Reg) | CREATE OR REPLACE MODEL enterprise_db.sales_model OPTIONS(model_type='linear_reg') AS SELECT label, feature1 FROM enterprise_db.train_data; | Trains linear regression model in BigQuery ML. |
| 56 | Evaluate ML Model | SELECT * FROM ML.EVALUATE(MODEL enterprise_db.sales_model); | Calculates evaluation metrics for ML model. |
| 57 | Predict using ML Model | SELECT * FROM ML.PREDICT(MODEL enterprise_db.sales_model, (SELECT feature1 FROM enterprise_db.test_data)); | Generates predictions using BQML model. |
| 58 | Generate Text Vertex AI | SELECT * FROM ML.GENERATE_TEXT(MODEL enterprise_db.gemini_model, TABLE enterprise_db.prompts); | Calls Gemini LLM via BigQuery ML. |
| 59 | Create Remote LLM Model | CREATE OR REPLACE MODEL enterprise_db.gemini_model REMOTE WITH CONNECTION `us.my_connection` OPTIONS(endpoint='gemini-pro'); | Links Gemini Pro model in BQML. |
| 60 | Create Table Snapshot | CREATE SNAPSHOT TABLE enterprise_db.users_snap_2026 CLONE enterprise_db.users OPTIONS(expiration_timestamp=TIMESTAMP '2026-12-31 23:59:59 UTC'); | Creates immutable table snapshot. |
| 61 | Restore Table Snapshot | CREATE TABLE enterprise_db.users_restored CLONE enterprise_db.users_snap_2026; | Restores table from snapshot clone. |
| 62 | Time Travel Query System Time | SELECT * FROM `enterprise_db.users` FOR SYSTEM_TIME AS OF TIMESTAMP_SUB(CURRENT_TIMESTAMP(), INTERVAL 1 HOUR); | Queries table state 1 hour ago. |
| 63 | List Row Access Policies | SELECT * FROM `enterprise_db.INFORMATION_SCHEMA.ROW_ACCESS_POLICIES`; | Lists active row security policies. |
| 64 | Drop Row Access Policy | DROP ROW ACCESS POLICY region_filter ON enterprise_db.users; | Removes row-level security policy. |
| 65 | Create Policy Tag Taxonomy | gcloud data-catalog taxonomies create "PII Taxonomy" --location=us | Provisions Data Catalog taxonomy for column masking. |
| 66 | Create Policy Tag | gcloud data-catalog policy-tags create --taxonomy="PII Taxonomy" --display-name="High Sensitivity" | Provisions policy tag for column-level security. |
| 67 | Grant Policy Tag Role | gcloud data-catalog policy-tags add-iam-policy-binding ... --role="roles/datacatalog.categoryFineGrainedReader" --member="user:analyst@org.com" | Grants read access to masked column. |
| 68 | Set Table Column Policy Tag | ALTER TABLE enterprise_db.users ALTER COLUMN ssn SET POLICY TAGS ('projects/proj/locations/us/taxonomies/tax/policyTags/tag1'); | Applies policy tag to sensitive column. |
| 69 | Create Table Clone | CREATE TABLE enterprise_db.users_clone CLONE enterprise_db.users; | Creates zero-copy clone of table. |
| 70 | Drop Materialized View | DROP MATERIALIZED VIEW enterprise_db.summary; | Deletes materialized view. |
| 71 | Refresh Materialized View | CALL BQ.REFRESH_MATERIALIZED_VIEW('enterprise_db.summary'); | Triggers manual refresh of materialized view. |
| 72 | Check Table Column Types | SELECT column_name, data_type FROM `enterprise_db.INFORMATION_SCHEMA.COLUMNS` WHERE table_name='users'; | Inspects schema column types. |
| 73 | Check Table Constraints | SELECT * FROM `enterprise_db.INFORMATION_SCHEMA.TABLE_CONSTRAINTS`; | Lists primary key and foreign key constraints. |
| 74 | Add Primary Key Constraint | ALTER TABLE enterprise_db.users ADD PRIMARY KEY (id) NOT ENFORCED; | Adds informational primary key constraint. |
| 75 | Add Foreign Key Constraint | ALTER TABLE enterprise_db.orders ADD CONSTRAINT fk_user FOREIGN KEY (user_id) REFERENCES enterprise_db.users(id) NOT ENFORCED; | Adds informational foreign key constraint. |
| 76 | Drop Search Index | DROP SEARCH INDEX idx_search ON enterprise_db.users; | Deletes full-text search index. |
| 77 | Create Vector Index | CREATE VECTOR INDEX idx_vec ON enterprise_db.embeddings(embedding) OPTIONS(distance_type='COSINE', index_type='IVF'); | Provisions IVF vector index for similarity search. |
| 78 | Drop Vector Index | DROP VECTOR INDEX idx_vec ON enterprise_db.embeddings; | Deletes vector index. |
| 79 | Check Streaming Buffer | SELECT table_name, num_rows, size_bytes FROM `enterprise_db.INFORMATION_SCHEMA.STREAMING_TIMELINE`; | Inspects uncommitted streaming insert buffer. |
| 80 | Check BI Engine Capacity | gcloud capacity-management reservations list --location=US | Inspects BI Engine in-memory reservation. |
| 81 | Create BI Engine Reservation | gcloud capacity-management reservations create --location=US --slots=100 --bi-engine-memory-gb=100 | Provisions in-memory BI Engine RAM. |
| 82 | Undrop Table (Time Travel) | CREATE TABLE enterprise_db.users AS SELECT * FROM `enterprise_db.users` FOR SYSTEM_TIME AS OF TIMESTAMP_SUB(CURRENT_TIMESTAMP(), INTERVAL 10 MINUTE); | Recovers dropped table data via System Time. |
| 83 | Query Audit Logs Cloud Logging | protoPayload.serviceName="bigquery.googleapis.com" AND protoPayload.methodName="jobservice.jobcompleted" | Queries Cloud Logging for BigQuery execution audit. |
| 84 | Check Reservation Assignments | bq ls --reservation_assignment --location=US prod_reservation | Lists projects assigned to slot reservation. |
| 85 | Delete Reservation Assignment | bq rm --reservation_assignment --location=US prod_reservation/assignment_id | Removes project from slot reservation. |
| 86 | Delete Reservation | bq rm --reservation --location=US prod_reservation | Deletes compute slot reservation. |
| 87 | Check Project Quotas | gcloud alpha services quota list --service=bigquery.googleapis.com | Inspects BigQuery API quota limits. |
| 88 | Set Max Billed Bytes Session | SET @@config.query_parameter_mode = 'NAMED'; SET @@GLOBAL.max_bytes_billed = 10000000000; | Caps query bytes billed to 10GB. |
| 89 | Set Default Dataset Session | SET @@dataset_id = 'enterprise_db'; | Configures default dataset for session. |
| 90 | Set Default Time Zone | SET @@time_zone = 'America/Phoenix'; | Configures default session time zone. |
| 91 | Check Project Location List | bq ls --locations | Lists supported geographic regions for dataset deployment. |
| 92 | Check bq CLI Version | bq version | Outputs running bq CLI tool version. |
| 93 | Purge Dataset Data | DELETE FROM `enterprise_db.logs` WHERE true; | Purges all rows from partitioned log table. |
| 94 | Get Dataset IAM Policy | bq get-iam-policy enterprise_db | Inspects JSON IAM policy bindings on dataset. |
| 95 | Set Dataset IAM Policy | bq set-iam-policy enterprise_db policy.json | Applies JSON IAM policy file to dataset. |
| 96 | List Data Transfer Runs | bq ls --transfer_run --transfer_config=projects/123/locations/us/transferConfigs/456 | Lists automated data ingestion runs. |
| 97 | Start Data Transfer Run | bq mk --transfer_run --parameters='{"run_time":"2026-07-29T00:00:00Z"}' projects/123/locations/us/transferConfigs/456 | Triggers manual data transfer execution. |
| 98 | Delete Data Transfer Config | bq rm --transfer_config projects/123/locations/us/transferConfigs/456 | Deletes automated data transfer configuration. |
| 99 | Verify BigQuery API Health | gcloud services list --enabled --filter="name:bigquery.googleapis.com" | Verifies BigQuery GCP service enablement. |
| 100 | Export Dataset Metadata JSON | bq show --format=json enterprise_db | Outputs complete dataset metadata as JSON payload. |
| 101 | Check Dataset Default Partition Expiration | bq show --format=prettyjson enterprise_db | grep defaultPartitionExpirationMs | Inspects default partition expiration time for dataset. |
| 102 | Check Dataset Default Table Expiration | bq show --format=prettyjson enterprise_db | grep defaultTableExpirationMs | Inspects default table expiration time for dataset. |
| 103 | Check Dataset Access Control IAM | bq show --format=prettyjson enterprise_db | grep access | Inspects JSON IAM access list for dataset. |
| 104 | Check Dataset KMS Key Name | bq show --format=prettyjson enterprise_db | grep defaultKmsKeyName | Inspects customer-managed encryption key (CMEK) name. |
| 105 | Check Table Creation Time | bq show --format=prettyjson enterprise_db.users | grep creationTime | Inspects table creation timestamp. |
| 106 | Check Table Last Modified Time | bq show --format=prettyjson enterprise_db.users | grep lastModifiedTime | Inspects table last modification timestamp. |
| 107 | Check Table Total Bytes | bq show --format=prettyjson enterprise_db.users | grep numBytes | Inspects total physical storage bytes for table. |
| 108 | Check Table Total Rows | bq show --format=prettyjson enterprise_db.users | grep numRows | Inspects total row count for table. |
| 109 | Check Table Type | bq show --format=prettyjson enterprise_db.users | grep type | Inspects table type (TABLE, VIEW, MATERIALIZED_VIEW, EXTERNAL). |
| 110 | Check Table Partitioning Type | bq show --format=prettyjson enterprise_db.logs | grep timePartitioning | Inspects time partitioning configuration (DAY, HOUR, MONTH, YEAR). |
| 111 | Check Project ID SQL | SELECT @@project_id; | Returns active GCP project ID. |
| 112 | Check Region ID SQL | SELECT @@location; | Returns active GCP location string. |
| 113 | Check Session User SQL | SELECT SESSION_USER(); | Returns current execution user email. |
| 114 | Check Current Timestamp SQL | SELECT CURRENT_TIMESTAMP(); | Returns current UTC timestamp. |
| 115 | Check Current Date SQL | SELECT CURRENT_DATE(); | Returns current UTC date. |
| 116 | Check Current Time SQL | SELECT CURRENT_TIME(); | Returns current UTC time. |
| 117 | Check Ping Query SQL | SELECT 1; | Simple connection ping test returning 1. |
| 118 | Check bq Version CLI | bq version | Outputs bq tool version string. |
| 119 | Check gcloud Version CLI | gcloud version | Outputs gcloud SDK version string. |
| 120 | Check Dataset List CLI | bq ls | Lists all datasets in active project. |
| 121 | Check Jobs List CLI | bq ls -j | Lists recent jobs in active project. |
| 122 | Check Models List CLI | bq ls --models enterprise_db | Lists BQML models in dataset. |
| 123 | Check Routines List CLI | bq ls --routines enterprise_db | Lists procedures and UDFs in dataset. |
| 124 | Check Transfer Configs List CLI | bq ls --transfer_config | Lists automated data transfers. |
| 125 | Check Transfer Logs CLI | bq ls --transfer_run | Lists data transfer runs. |
| 126 | Check Capacity Commitments List CLI | bq ls --capacity_commitment --location=US | Lists slot commitments. |
| 127 | Check Reservations List CLI | bq ls --reservation --location=US | Lists slot reservations. |
| 128 | Check Assignments List CLI | bq ls --reservation_assignment --location=US | Lists reservation assignments. |
| 129 | Check Connections List CLI | bq ls --connection --location=US | Lists BigLake connections. |
| 130 | Check Service Enablement API | gcloud services list --filter='name:bigquery.googleapis.com' | Verifies BigQuery API status. |
| 131 | Export Dataset Metadata JSON | bq show --format=json enterprise_db | Outputs complete dataset metadata as JSON payload. |
| 132 | Check Project Quotas CLI | gcloud alpha services quota list --service=bigquery.googleapis.com | Inspects quota limits for project. |
| 133 | Check Project Active Jobs Count | bq ls -j -a --state=RUNNING | wc -l | Counts active running jobs in project. |
| 134 | Check Project Pending Jobs Count | bq ls -j -a --state=PENDING | wc -l | Counts pending queued jobs in project. |
| 135 | Check Dataset Location | bq show --format=prettyjson enterprise_db | grep location | Inspects dataset deployment location (US, EU). |
| 136 | Create Dataset (Alt 135) | bq mk --dataset --location=US enterprise_db | Provisions BigQuery dataset container. |
| 137 | Delete Dataset (Alt 136) | bq rm -r -f enterprise_db | Removes dataset and contents. |
| 138 | Create Table from CSV (Alt 137) | bq load --source_format=CSV enterprise_db.users gs://bucket/users.csv id:INTEGER,name:STRING | Bulk loads CSV into table. |
| 139 | Run Interactive Query (Alt 138) | bq query --use_legacy_sql=false 'SELECT COUNT(*) FROM `enterprise_db.users`' | Executes SQL query via CLI. |
| 140 | Cancel Running Query (Alt 139) | bq cancel job_id_12345 | Stops active query job. |
| 141 | List Dataset Tables (Alt 140) | bq ls enterprise_db | Lists tables inside dataset. |
| 142 | Show Table Schema (Alt 141) | bq show enterprise_db.users | Inspects table column definitions. |
| 143 | Delete Table (Alt 142) | bq rm -f enterprise_db.users | Deletes analytical table. |
| 144 | Create Partitioned Table (Alt 143) | CREATE TABLE enterprise_db.logs (log_date DATE, message STRING) PARTITION BY log_date; | Provisions time-partitioned table. |
| 145 | Create Clustered Table (Alt 144) | CREATE TABLE enterprise_db.users (id INT64, email STRING) CLUSTER BY email; | Provisions clustered table. |
| 146 | Create Authorized View (Alt 145) | CREATE VIEW enterprise_db.public_users AS SELECT id, name FROM enterprise_db.users; | Provisions secure reporting view. |
| 147 | Create Materialized View (Alt 146) | CREATE MATERIALIZED VIEW enterprise_db.summary AS SELECT dept, COUNT(*) FROM enterprise_db.users GROUP BY dept; | Provisions pre-computed materialized view. |
| 148 | Create External Table (GCS) (Alt 147) | CREATE EXTERNAL TABLE enterprise_db.ext_logs OPTIONS (format='PARAVIEW', uris=['gs://bucket/*.parquet']); | Links external cloud storage. |
| 149 | Grant Dataset Permission (Alt 148) | bq add-iam-policy-binding --member='user:analyst@org.com' --role='roles/bigquery.dataViewer' enterprise_db | Assigns dataset access rights. |
| 150 | Create Reservation (Slots) (Alt 149) | bq mk --reservation --location=US --slots=100 prod_reservation | Provisions dedicated analytical capacity. |
| 151 | Assign Project to Reservation (Alt 150) | bq mk --assignment --reservation_id=prod_reservation --project_id=my-org-proj | Links project to compute slots. |
| 152 | Explain Query Execution (Alt 151) | EXPLAIN SELECT * FROM `enterprise_db.users`; | Evaluates query execution tree. |
| 153 | Check Job History (Alt 152) | bq ls -j -n 20 | Inspects recent query execution jobs. |
| 154 | Create Routine (Stored Procedure) (Alt 153) | CREATE PROCEDURE enterprise_db.CleanupLogs() BEGIN DELETE FROM enterprise_db.logs WHERE log_date < DATE_SUB(CURRENT_DATE(), INTERVAL 90 DAY); END; | Provisions serverless stored procedure. |
| 155 | Execute Stored Procedure (Alt 154) | CALL enterprise_db.CleanupLogs(); | Runs stored procedure. |
| 156 | Create Row-Level Security Policy (Alt 155) | CREATE ROW ACCESS POLICY region_filter ON enterprise_db.users GRANT TO ('user:rep@org.com') FILTER USING (region = 'NA'); | Enforces row security filtering. |
| 157 | Create Data Transfer (S3) (Alt 156) | bq mk --transfer_config --data_source=amazon_s3 --target_dataset=enterprise_db --params='...' | Configures automated data ingestion. |
| 158 | Export Table to GCS (Alt 157) | bq extract --destination_format=PARQUET enterprise_db.users gs://bucket/export/*.parquet | Exports table data to cloud storage. |
| 159 | Copy Table (Alt 158) | bq cp enterprise_db.users enterprise_db.users_backup | Duplicates table snapshot. |
| 160 | Query Information Schema (Alt 159) | SELECT * FROM `enterprise_db.INFORMATION_SCHEMA.TABLES`; | Inspects metadata catalogue. |
| 161 | Check Storage Billing Tier (Alt 160) | SELECT * FROM `region-us.INFORMATION_SCHEMA.STORAGE_PRICING`; | Evaluates storage costs. |
| 162 | Create Data Masking Tag (Alt 161) | gcloud data-catalog taxonomies create ... | Sets up PII taxonomy tags. |
| 163 | Create Search Index (Alt 162) | CREATE SEARCH INDEX idx_search ON enterprise_db.users(ALL COLUMNS); | Provisions full-text search index. |
| 164 | Query Vector Search (Alt 163) | SELECT * FROM VECTOR_SEARCH(TABLE enterprise_db.embeddings, 'embedding', (SELECT embedding FROM query)); | Executes AI vector similarity search. |
| 165 | Get Project Metadata (Alt 164) | bq show my-org-proj: | Inspects project quota settings. |
| 166 | Update Dataset Metadata (Alt 165) | bq update --description 'Production database' enterprise_db | Updates dataset description metadata. |
| 167 | Update Table Expiration (Alt 166) | bq update --default_table_expiration 2592000 enterprise_db | Sets 30-day default table expiration for dataset. |
| 168 | Update Table Partition Expiration (Alt 167) | ALTER TABLE enterprise_db.logs SET OPTIONS (partition_expiration_days = 90); | Sets automatic partition drop after 90 days. |
| 169 | Require Partition Filter (Alt 168) | ALTER TABLE enterprise_db.logs SET OPTIONS (require_partition_filter = true); | Enforces partition filter in queries to prevent full scans. |
| 170 | List Jobs by State (Alt 169) | bq ls -j -a --state=RUNNING | Lists active running query jobs across project. |
| 171 | Show Job Details (Alt 170) | bq show -j job_id_12345 | Inspects detailed execution metrics and slot time for job. |
| 172 | Query Job Bytes Processed (Alt 171) | SELECT total_bytes_billed, total_slot_ms FROM `region-us.INFORMATION_SCHEMA.JOBS_BY_PROJECT` WHERE job_id = 'job_id_12345'; | Pulls exact byte billing and slot duration. |
| 173 | Query Slot Usage History (Alt 172) | SELECT * FROM `region-us.INFORMATION_SCHEMA.JOBS_TIMELINE_BY_PROJECT` WHERE period_start > TIMESTAMP_SUB(CURRENT_TIMESTAMP(), INTERVAL 1 HOUR); | Analyzes real-time slot allocation timeline. |
| 174 | Query Storage Bytes History (Alt 173) | SELECT table_schema, table_name, active_logical_bytes, long_term_logical_bytes FROM `region-us.INFORMATION_SCHEMA.TABLE_STORAGE`; | Inspects active vs long-term storage billing. |
| 175 | Change Storage Billing Model (Alt 174) | ALTER DATASET enterprise_db SET OPTIONS (storage_billing_model = 'PHYSICAL'); | Switches storage billing from logical to physical compressed. |
| 176 | Load Parquet File from GCS (Alt 175) | bq load --source_format=PARQUET enterprise_db.users gs://bucket/users.parquet | Bulk loads Parquet file into BigQuery table. |
| 177 | Load JSON File from GCS (Alt 176) | bq load --source_format=NEWLINE_DELIMITED_JSON enterprise_db.users gs://bucket/users.json id:INTEGER,name:STRING | Bulk loads NDJSON file into table. |
| 178 | Load Avro File from GCS (Alt 177) | bq load --source_format=AVRO enterprise_db.users gs://bucket/users.avro | Bulk loads Avro file into table. |
| 179 | Load ORC File from GCS (Alt 178) | bq load --source_format=ORC enterprise_db.users gs://bucket/users.orc | Bulk loads ORC file into table. |
| 180 | Create Iceberg Unverted BigLake Table (Alt 179) | CREATE EXTERNAL TABLE enterprise_db.iceberg_table WITH CONNECTION `us.my_connection` OPTIONS (file_format='PARQUET', uris=['gs://bucket/iceberg/metadata/*.metadata.json']); | Provisions BigLake Iceberg external table. |
| 181 | Create Cloud Resource Connection (Alt 180) | gcloud bigquery connections create cloud-resource my_connection --location=US | Provisions BigLake connection to GCS. |
| 182 | Show Cloud Connection (Alt 181) | gcloud bigquery connections describe my_connection --location=US | Inspects IAM service account for BigLake connection. |
| 183 | Grant IAM Role to Connection (Alt 182) | gsutil iam ch serviceAccount:service-123@gcp-sa-bigqueryconnections.iam.gserviceaccount.com:objectViewer gs://bucket | Grants GCS read access to connection. |
| 184 | Create AWS BigLake Connection (Alt 183) | gcloud bigquery connections create aws my_aws_conn --location=US --access-role=arn:aws:iam::123:role/BigQueryRole | Provisions cross-cloud connection to AWS S3. |
| 185 | Create Azure BigLake Connection (Alt 184) | gcloud bigquery connections create azure my_azure_conn --location=US --tenant-id=xyz... | Provisions cross-cloud connection to Azure Blob. |
| 186 | Create Federated Query MySQL (Alt 185) | SELECT * FROM EXTERNAL_QUERY('us.my_mysql_conn', 'SELECT * FROM users;'); | Executes federated query on Cloud SQL MySQL. |
| 187 | Create Federated Query Postgres (Alt 186) | SELECT * FROM EXTERNAL_QUERY('us.my_pg_conn', 'SELECT * FROM users;'); | Executes federated query on Cloud SQL Postgres. |
| 188 | Create Remote Function Vertex AI (Alt 187) | CREATE FUNCTION enterprise_db.predict_text(prompt STRING) RETURNS STRING REMOTE WITH CONNECTION `us.my_connection` OPTIONS (endpoint='https://us-central1-aiplatform.googleapis.com/...'); | Provisions remote function calling Vertex AI. |
| 189 | Create ML Model (K-Means) (Alt 188) | CREATE OR REPLACE MODEL enterprise_db.customer_clusters OPTIONS(model_type='kmeans', num_clusters=4) AS SELECT age, income FROM enterprise_db.users; | Trains K-Means clustering model in SQL. |
| 190 | Create ML Model (Linear Reg) (Alt 189) | CREATE OR REPLACE MODEL enterprise_db.sales_model OPTIONS(model_type='linear_reg') AS SELECT label, feature1 FROM enterprise_db.train_data; | Trains linear regression model in BigQuery ML. |
| 191 | Evaluate ML Model (Alt 190) | SELECT * FROM ML.EVALUATE(MODEL enterprise_db.sales_model); | Calculates evaluation metrics for ML model. |
| 192 | Predict using ML Model (Alt 191) | SELECT * FROM ML.PREDICT(MODEL enterprise_db.sales_model, (SELECT feature1 FROM enterprise_db.test_data)); | Generates predictions using BQML model. |
| 193 | Generate Text Vertex AI (Alt 192) | SELECT * FROM ML.GENERATE_TEXT(MODEL enterprise_db.gemini_model, TABLE enterprise_db.prompts); | Calls Gemini LLM via BigQuery ML. |
| 194 | Create Remote LLM Model (Alt 193) | CREATE OR REPLACE MODEL enterprise_db.gemini_model REMOTE WITH CONNECTION `us.my_connection` OPTIONS(endpoint='gemini-pro'); | Links Gemini Pro model in BQML. |
| 195 | Create Table Snapshot (Alt 194) | CREATE SNAPSHOT TABLE enterprise_db.users_snap_2026 CLONE enterprise_db.users OPTIONS(expiration_timestamp=TIMESTAMP '2026-12-31 23:59:59 UTC'); | Creates immutable table snapshot. |
| 196 | Restore Table Snapshot (Alt 195) | CREATE TABLE enterprise_db.users_restored CLONE enterprise_db.users_snap_2026; | Restores table from snapshot clone. |
| 197 | Time Travel Query System Time (Alt 196) | SELECT * FROM `enterprise_db.users` FOR SYSTEM_TIME AS OF TIMESTAMP_SUB(CURRENT_TIMESTAMP(), INTERVAL 1 HOUR); | Queries table state 1 hour ago. |
| 198 | List Row Access Policies (Alt 197) | SELECT * FROM `enterprise_db.INFORMATION_SCHEMA.ROW_ACCESS_POLICIES`; | Lists active row security policies. |
| 199 | Drop Row Access Policy (Alt 198) | DROP ROW ACCESS POLICY region_filter ON enterprise_db.users; | Removes row-level security policy. |
| 200 | Create Policy Tag Taxonomy (Alt 199) | gcloud data-catalog taxonomies create "PII Taxonomy" --location=us | Provisions Data Catalog taxonomy for column masking. |
Amazon Redshift OLAP
Technical Architecture & Overview
Amazon Redshift is a fully managed, petabyte-scale cloud data warehouse service. It utilizes columnar storage, RA3 compute nodes with managed AQUA storage caching, massively parallel processing (MPP), and Redshift Spectrum to query external data directly in AWS S3 lakes.
Primary Use Cases: Enterprise data warehousing, business intelligence reporting, large-scale SQL analytics, cross-account zero-copy data sharing, and data lake querying via Redshift Spectrum.
Core Components: Leader Node (Query Parsing/Optimization), Compute Nodes (MPP Execution Slices), RA3 Managed Storage, Redshift Spectrum Engine, and Workload Management (WLM) queues.
Exhaustive 200-command administrative, diagnostic, and operational matrix for Amazon Redshift.
| # | Operation / Action | AWS CLI / SQL Syntax | Description |
|---|---|---|---|
| 1 | Create Redshift Cluster | aws redshift create-cluster --cluster-identifier prod-redshift --node-type ra3.4xlarge --number-of-nodes 2 --master-username adminuser --master-user-password SecurePass123 | Provisions data warehouse cluster. |
| 2 | Delete Redshift Cluster | aws redshift delete-cluster --cluster-identifier prod-redshift --skip-final-snapshot | Decommissions Redshift cluster. |
| 3 | Pause Cluster | aws redshift pause-cluster --cluster-identifier prod-redshift | Halts billing compute nodes. |
| 4 | Resume Cluster | aws redshift resume-cluster --cluster-identifier prod-redshift | Boots paused cluster. |
| 5 | Create Snapshot | aws redshift create-cluster-snapshot --cluster-identifier prod-redshift --snapshot-identifier shift-backup-01 | Takes manual storage backup. |
| 6 | Restore Cluster from Snapshot | aws redshift restore-from-cluster-snapshot --cluster-identifier prod-redshift-restored --snapshot-identifier shift-backup-01 | Restores cluster backup snapshot. |
| 7 | Modify Cluster Sizing | aws redshift modify-cluster --cluster-identifier prod-redshift --node-type ra3.16xlarge | Scales warehouse instance types. |
| 8 | Create Serverless Workgroup | aws redshift-serverless create-workgroup --workgroup-name prod-wg --namespace-name prod-ns --base-capacity 32 | Provisions serverless Redshift pool. |
| 9 | Delete Serverless Workgroup | aws redshift-serverless delete-workgroup --workgroup-name prod-wg | Deletes serverless workgroup. |
| 10 | Connect via PostgreSQL Client | psql -h prod-redshift.123.us-east-1.redshift.amazonaws.com -p 5439 -U adminuser -d dev | Connects to Redshift cluster. |
| 11 | Create Database | CREATE DATABASE enterprise_db; | Provisions new analytical database. |
| 12 | Create Schema | CREATE SCHEMA enterprise_db.analytics; | Provisions logical database schema. |
| 13 | Create Table (Dist/Sort Key) | CREATE TABLE users (id INT, email VARCHAR(255)) DISTKEY(id) SORTKEY(email); | Provisions optimized columnar table. |
| 14 | Copy Data from S3 | COPY users FROM 's3://my-bucket/users.csv' IAM_ROLE 'arn:aws:iam::123:role/RedshiftRole' CSV; | Bulk loads files from S3. |
| 15 | Vacuum Table | VACUUM FULL users; | Defragments and resorts table storage. |
| 16 | Analyze Table Stats | ANALYZE users; | Refreshes query optimizer statistics. |
| 17 | Explain Query Plan | EXPLAIN SELECT * FROM users; | Evaluates query execution tree. |
| 18 | Check Running Queries | SELECT * FROM stv_recents WHERE status = 'Running'; | Inspects active query threads. |
| 19 | Cancel Query | CANCEL 48291; | Terminates long-running query. |
| 20 | Create User | CREATE USER app_user PASSWORD 'SecurePass!'; | Provisions cluster user. |
| 21 | Grant Schema Privileges | GRANT USAGE ON SCHEMA enterprise_db TO app_user; | Assigns database access rights. |
| 22 | Create External Schema (Glue) | CREATE EXTERNAL SCHEMA external_s3 FROM DATA CATALOG DATABASE 'glue_db' IAM_ROLE 'arn:aws:iam::123:role/GlueRole'; | Links AWS Glue catalog. |
| 23 | Create Materialized View | CREATE MATERIALIZED VIEW user_summary AS SELECT email, COUNT(*) FROM users GROUP BY email; | Provisions pre-computed view. |
| 24 | Refresh Materialized View | REFRESH MATERIALIZED VIEW user_summary; | Updates materialized view records. |
| 25 | Create Datashare | CREATE DATASHARE sales_share; GRANT USAGE ON DATASHARE sales_share TO NAMESPACE 'other_ns'; | Shares zero-copy data securely. |
| 26 | Check Table Encoding | SELECT * FROM svv_table_info WHERE table = 'users'; | Inspects column compression encodings. |
| 27 | Check Disk Space Utilization | SELECT * FROM stv_blocklist; | Evaluates physical disk block usage. |
| 28 | Create Stored Procedure | CREATE OR REPLACE PROCEDURE refresh_data() LANGUAGE plpgsql AS $$ BEGIN REFRESH MATERIALIZED VIEW user_summary; END; $$; | Provisions serverless procedure. |
| 29 | Execute Stored Procedure | CALL refresh_data(); | Runs stored procedure. |
| 30 | Check Event Logs | SELECT * FROM stl_error WHERE userid > 1; | Inspects system error logs. |
| 31 | Reboot Cluster | aws redshift reboot-cluster --cluster-identifier prod-redshift | Restarts compute nodes in Redshift cluster. |
| 32 | Modify Cluster Parameter Group | aws redshift modify-cluster-parameter-group --parameter-group-name custom-redshift-pg --parameters "ParameterName=enable_user_activity_logging,ParameterValue=true,ApplyMethod=immediate" | Enforces user audit logging. |
| 33 | Create Parameter Group | aws redshift create-cluster-parameter-group --parameter-group-name custom-redshift-pg --parameter-group-family redshift-1.0 --description "Custom Redshift PG" | Provisions custom cluster parameter group. |
| 34 | Describe Parameter Groups | aws redshift describe-cluster-parameter-groups | Lists all Redshift parameter groups. |
| 35 | Delete Parameter Group | aws redshift delete-cluster-parameter-group --parameter-group-name custom-redshift-pg | Deletes custom parameter group. |
| 36 | Create Subnet Group | aws redshift create-cluster-subnet-group --cluster-subnet-group-name redshift-subnets --subnet-ids subnet-123 subnet-456 --description "Redshift subnets" | Provisions VPC subnet group. |
| 37 | Describe Subnet Groups | aws redshift describe-cluster-subnet-groups | Lists VPC subnet groups. |
| 38 | Delete Subnet Group | aws redshift delete-cluster-subnet-group --cluster-subnet-group-name redshift-subnets | Deletes VPC subnet group. |
| 39 | Create Serverless Namespace | aws redshift-serverless create-namespace --namespace-name prod-ns --db-name dev --admin-username adminuser --admin-user-password SecurePass123 | Provisions serverless namespace container. |
| 40 | Delete Serverless Namespace | aws redshift-serverless delete-namespace --namespace-name prod-ns | Deletes serverless namespace container. |
| 41 | Get Serverless Workgroup | aws redshift-serverless get-workgroup --workgroup-name prod-wg | Inspects status and base RPU capacity. |
| 42 | Update Serverless Workgroup | aws redshift-serverless update-workgroup --workgroup-name prod-wg --base-capacity 64 | Scales base RPU capacity. |
| 43 | Create Scheduled Action | aws redshift create-scheduled-action --scheduled-action-name pause-nightly --target-action '{"PauseCluster":{"ClusterIdentifier":"prod-redshift"}}' --schedule 'cron(0 0 * * ? *)' --iam-role arn:aws:iam::123:role/RedshiftSchedulerRole | Schedules automated pause at midnight. |
| 44 | Delete Scheduled Action | aws redshift delete-scheduled-action --scheduled-action-name pause-nightly | Deletes automated scheduled action. |
| 45 | List Scheduled Actions | aws redshift describe-scheduled-actions | Lists all scheduled pause/resume actions. |
| 46 | Unload Query to S3 | UNLOAD ('SELECT * FROM users') TO 's3://my-bucket/unload/' IAM_ROLE 'arn:aws:iam::123:role/RedshiftRole' PARQUET; | Exports query results directly to S3 in Parquet. |
| 47 | Unload Partitioned to S3 | UNLOAD ('SELECT * FROM users') TO 's3://my-bucket/unload/' IAM_ROLE 'arn:aws:iam::123:role/RedshiftRole' PARTITION BY (dept) PARQUET; | Exports partitioned Parquet files to S3. |
| 48 | Copy Parquet from S3 | COPY users FROM 's3://my-bucket/data.parquet' IAM_ROLE 'arn:aws:iam::123:role/RedshiftRole' FORMAT AS PARQUET; | Bulk loads Parquet file from S3. |
| 49 | Copy JSON from S3 | COPY users FROM 's3://my-bucket/data.json' IAM_ROLE 'arn:aws:iam::123:role/RedshiftRole' FORMAT AS JSON 'auto'; | Bulk loads JSON file from S3. |
| 50 | Check Copy Errors | SELECT * FROM stl_load_errors ORDER BY starttime DESC LIMIT 10; | Inspects bulk load file formatting errors. |
| 51 | Check Query WLM Queues | SELECT * FROM stv_wlm_query_state; | Inspects Workload Management execution queues. |
| 52 | Check WLM Service Class Stats | SELECT * FROM stv_wlm_service_class_state; | Monitors concurrency and memory allocation per WLM queue. |
| 53 | Create Auto WLM Queue | ALTER SERVICE CLASS 6 SET query_concurrency = 15; | Configures WLM query queue concurrency. |
| 54 | Set Query Concurrency Scaling | ALTER SERVICE CLASS 6 SET max_execution_time = 300000; | Caps query execution time in queue to 5m. |
| 55 | Check Concurrency Scaling Clusters | SELECT * FROM stl_concurrency_scaling_run; | Monitors dynamic burst cluster activation. |
| 56 | Check Table Disk Fragmentation | SELECT "table", unsorted, vacuum_sort_benefit FROM svv_table_info; | Identifies tables needing VACUUM SORT. |
| 57 | Vacuum Sort Table | VACUUM SORT users; | Resorts table rows based on defined SORTKEY. |
| 58 | Vacuum Reindex Table | VACUUM REINDEX users; | Rebuilds interleaved sort key index structures. |
| 59 | Analyze Compression Encodings | ANALYZE COMPRESSION users; | Generates recommended column encodings (AZ64, ZSTD). |
| 60 | Alter Table Alter Column Encoding | ALTER TABLE users ALTER COLUMN email ENCODE ZSTD; | Updates column compression encoding. |
| 61 | Create Interleaved Sortkey Table | CREATE TABLE events (id INT, dt DATE) INTERLEAVED SORTKEY (id, dt); | Provisions multi-dimensional sort key table. |
| 62 | Create Diststyle All Table | CREATE TABLE dim_status (id INT, status VARCHAR(20)) DISTSTYLE ALL; | Replicates small lookup table across all compute nodes. |
| 63 | Create Diststyle Even Table | CREATE TABLE staging_logs (msg VARCHAR(500)) DISTSTYLE EVEN; | Distributes rows evenly via round-robin across nodes. |
| 64 | Create Diststyle Auto Table | CREATE TABLE users (id INT, name VARCHAR(50)) DISTSTYLE AUTO; | Lets Redshift automatically choose optimal distribution. |
| 65 | Check Node Slice Distribution | SELECT slice, count(*) FROM stv_slices GROUP BY slice; | Evaluates data slice distribution uniformity. |
| 66 | Check Table Slice Storage | SELECT slice, col, count(*) FROM stv_blocklist GROUP BY slice, col; | Inspects physical column block storage across slices. |
| 67 | Check Query Execution Time | SELECT query, starttime, endtime, datediff(millisecond, starttime, endtime) AS duration_ms FROM stl_query WHERE query = 48291; | Measures query duration. |
| 68 | Check Query Plan Execution Graph | SELECT * FROM svl_qlog WHERE query = 48291; | Inspects detailed execution step log. |
| 69 | Check Disk Spill Queries | SELECT query, step, rows, workmem, is_diskbased FROM svl_query_summary WHERE is_diskbased = 't'; | Identifies queries spilling hash joins to disk. |
| 70 | Check Query Alert Details | SELECT * FROM stl_alert_event_where_clause WHERE query = 48291; | Inspects query optimizer alert warnings. |
| 71 | Create User Group | CREATE GROUP data_engineers; | Provisions security role group. |
| 72 | Add User to Group | ALTER GROUP data_engineers ADD USER app_user; | Adds user to security group. |
| 73 | Remove User from Group | ALTER GROUP data_engineers DROP USER app_user; | Removes user from security group. |
| 74 | Drop User Group | DROP GROUP data_engineers; | Deletes security group. |
| 75 | Alter User Password | ALTER USER app_user PASSWORD 'NewSecurePass123!'; | Updates user login password. |
| 76 | Disable User Login | ALTER USER app_user DISABLE; | Disables user authentication. |
| 77 | Enable User Login | ALTER USER app_user ENABLE; | Enables user authentication. |
| 78 | Drop User | DROP USER IF EXISTS app_user; | Deletes user account. |
| 79 | Grant Table Select | GRANT SELECT ON ALL TABLES IN SCHEMA enterprise_db TO app_user; | Grants read access on all schema tables. |
| 80 | Revoke Table Privileges | REVOKE ALL ON TABLE users FROM app_user; | Revokes permissions on table. |
| 81 | Set Default Schema Privileges | ALTER DEFAULT PRIVILEGES IN SCHEMA enterprise_db GRANT SELECT ON TABLES TO app_user; | Sets automatic grants for future tables. |
| 82 | Create Dynamic Masking Policy | CREATE MASKING POLICY email_mask WITH (val VARCHAR) AS CASE WHEN CURRENT_USER = 'admin' THEN val ELSE 'xxx@xxx.com' END; | Provisions PII column masking policy. |
| 83 | Attach Masking Policy | ATTACH MASKING POLICY email_mask ON users(email) TO app_user; | Enforces masking policy on table column. |
| 84 | Detach Masking Policy | DETACH MASKING POLICY email_mask ON users(email) FROM app_user; | Removes masking policy. |
| 85 | Create Row-Level Security Policy | CREATE RLS POLICY region_rls WITH (dept VARCHAR) AS dept = CURRENT_USER; | Provisions RLS policy. |
| 86 | Attach RLS Policy | ATTACH RLS POLICY region_rls ON users TO ROLE analyst_role; | Enforces RLS policy on table. |
| 87 | Detach RLS Policy | DETACH RLS POLICY region_rls ON users FROM ROLE analyst_role; | Removes RLS policy. |
| 88 | Create Datashare Consumer | CREATE DATABASE sales_db_consumer FROM DATASHARE sales_share OF NAMESPACE 'producer_ns'; | Mounts datashare in consumer cluster. |
| 89 | Show Datashares | SHOW DATASHARES; | Lists all inbound and outbound datashares. |
| 90 | Drop Datashare | DROP DATASHARE sales_share; | Removes zero-copy datashare. |
| 91 | Create Auto Refresh Materialized View | CREATE MATERIALIZED VIEW mv_live AUTO REFRESH YES AS SELECT id, count(*) FROM users GROUP BY id; | Provisions auto-refreshing materialized view. |
| 92 | Check Materialized View Status | SELECT * FROM stv_mv_info; | Inspects materialized view refresh state. |
| 93 | Check Spectrum External Tables | SELECT * FROM svv_external_tables; | Lists all AWS Glue / Redshift Spectrum tables. |
| 94 | Check Spectrum Query Metrics | SELECT * FROM svl_s3query_summary; | Measures S3 scan bytes and S3 query duration. |
| 95 | Check Active Cluster Connections SQL | SELECT * FROM stv_sessions; | Lists active client connection sessions. |
| 96 | Check System Table Storage Usage | SELECT * FROM svv_table_info; | Inspects size, sortkey, distkey, and skew. |
| 97 | Verify Redshift Version | SELECT version(); | Outputs running Redshift PostgreSQL engine version string. |
| 98 | Check Redshift Cluster Health API | aws redshift describe-clusters --cluster-identifier prod-redshift --query "Clusters[0].ClusterStatus" | Inspects cluster operational health status via AWS CLI. |
| 99 | Check Redshift Serverless Health API | aws redshift-serverless get-workgroup --workgroup-name prod-wg --query "workgroup.status" | Inspects serverless workgroup health via AWS CLI. |
| 100 | Set Statement Timeout Session | SET statement_timeout = 60000; | Caps session query duration to 60 seconds. |
| 101 | Check Cluster Node Slices Count | SELECT count(*) FROM stv_slices; | Calculates total MPP execution slices across cluster. |
| 102 | Check Table Storage Distribution Style | SELECT "table", diststyle FROM svv_table_info; | Inspects distribution style (KEY, EVEN, ALL, AUTO). |
| 103 | Check Table Sort Key Style | SELECT "table", sortkey_1, num_sortkeys FROM svv_table_info; | Inspects primary sort key columns. |
| 104 | Check Table Skew Rows Metric | SELECT "table", skew_rows FROM svv_table_info; | Measures row distribution imbalance across slices (closer to 1 = balanced). |
| 105 | Check Table Skew Sort Key Metric | SELECT "table", skew_sortkey1 FROM svv_table_info; | Measures sort key data skew. |
| 106 | Check Table Unsorted Rows Metric | SELECT "table", unsorted FROM svv_table_info; | Measures percentage of unsorted rows needing VACUUM SORT. |
| 107 | Check Table Vacuum Benefit Metric | SELECT "table", vacuum_sort_benefit FROM svv_table_info; | Measures estimated performance benefit of running VACUUM. |
| 108 | Check Table Block Size MB | SELECT "table", size FROM svv_table_info; | Calculates table storage size in 1MB blocks. |
| 109 | Check Query WLM Service Class | SELECT query, service_class, slot_count FROM stl_wlm_query WHERE query = 48291; | Inspects WLM queue assignment and slot allocation. |
| 110 | Check Query WLM Queue Time | SELECT query, queue_time, exec_time FROM stl_wlm_query WHERE query = 48291; | Measures time spent queuing vs executing. |
| 111 | Check Query Memory Workmem | SELECT query, workmem FROM stl_wlm_query WHERE query = 48291; | Inspects RAM allocated to query in WLM queue. |
| 112 | Check Query Disk Spill Rows | SELECT query, step, rows, workmem, is_diskbased FROM svl_query_summary WHERE is_diskbased = 't'; | Identifies operators spilling data to disk. |
| 113 | Check Query Step Latency | SELECT query, step, rows, bytes, workmem FROM svl_query_summary WHERE query = 48291 ORDER BY step; | Pulls step-by-step physical operator execution graph. |
| 114 | Check Query Alert Warnings | SELECT query, event, solution FROM stl_alert_event_where_clause WHERE query = 48291; | Pulls performance warning alerts from optimizer. |
| 115 | Check Query Broadcast Joins | SELECT query, label FROM svl_qlog WHERE query = 48291 AND label LIKE '%Broadcast%'; | Identifies broadcast join steps. |
| 116 | Check Query Redistribute Joins | SELECT query, label FROM svl_qlog WHERE query = 48291 AND label LIKE '%DS_BCAST%' OR label LIKE '%DS_DIST%'; | Identifies network row redistribution steps. |
| 117 | Check Spectrum S3 Query Execution | SELECT query, s3_scanned_bytes, s3_scanned_rows FROM svl_s3query_summary WHERE query = 48291; | Measures S3 scan bytes and rows for Spectrum query. |
| 118 | Check Spectrum External Table Details | SELECT * FROM svv_external_tables WHERE tablename = 'ext_users'; | Inspects Glue catalog external table location and format. |
| 119 | Check Spectrum External Partition Details | SELECT * FROM svv_external_partitions WHERE tablename = 'ext_users'; | Lists external table partitions registered in Glue. |
| 120 | Check Spectrum File Format Info | SELECT * FROM svv_external_columns WHERE tablename = 'ext_users'; | Inspects column data types for Spectrum table. |
| 121 | Check Datashare Producer Status | SELECT * FROM svv_datashares; | Lists outbound datashares created on cluster. |
| 122 | Check Datashare Consumer Status | SELECT * FROM svv_datashare_consumers; | Lists consumer clusters attached to datashare. |
| 123 | Check Datashare Objects List | SELECT * FROM svv_datashare_objects; | Lists tables and views included in datashare. |
| 124 | Check Materialized View Refresh Status | SELECT * FROM stv_mv_info; | Inspects refresh mode (AUTO/MANUAL) and status. |
| 125 | Check Materialized View Dependencies | SELECT * FROM stv_mv_deps; | Inspects underlying tables governing materialized view. |
| 126 | Check Concurrency Scaling Runs History | SELECT * FROM stl_concurrency_scaling_run ORDER BY start_time DESC LIMIT 10; | Inspects historical burst cluster runs. |
| 127 | Check Concurrency Scaling Usage Metrics | SELECT * FROM stl_concurrency_scaling_usage; | Monitors accumulated concurrency scaling credits. |
| 128 | Check User Activity Audit Log | SELECT * FROM stl_connection_log ORDER BY starttime DESC LIMIT 10; | Inspects user login/logout audit trail. |
| 129 | Check User Query Audit Log | SELECT * FROM stl_query WHERE userid > 1 ORDER BY starttime DESC LIMIT 10; | Inspects executed query text and timestamps. |
| 130 | Check Database Error Log | SELECT * FROM stl_error ORDER BY starttime DESC LIMIT 10; | Inspects system error messages. |
| 131 | Check Database Disk Space Blocklist | SELECT count(*) FROM stv_blocklist; | Calculates total occupied 1MB storage blocks. |
| 132 | Check Database Disk Space Free Blocks | SELECT count(*) FROM stv_blocklist WHERE tbl = 0; | Calculates unallocated free 1MB storage blocks. |
| 133 | Check Database Node Hardware Info | SELECT * FROM stv_node_storage_capacity; | Inspects total, used, and free storage per node. |
| 134 | Check Database Cluster Status AWS CLI | aws redshift describe-clusters --cluster-identifier prod-redshift --query "Clusters[0].ClusterStatus" | Verifies if cluster status is available. |
| 135 | Check Database Cluster Health AWS CLI | aws redshift describe-clusters --cluster-identifier prod-redshift --query "Clusters[0].HealthStatus" | Verifies if cluster health is Healthy. |
| 136 | Check Serverless Workgroup Status AWS CLI | aws redshift-serverless get-workgroup --workgroup-name prod-wg --query "workgroup.status" | Verifies if serverless workgroup status is AVAILABLE. |
| 137 | Check Serverless Base Capacity RPU | aws redshift-serverless get-workgroup --workgroup-name prod-wg --query "workgroup.baseCapacity" | Inspects configured base RPU capacity. |
| 138 | Check Serverless Usage Limits AWS CLI | aws redshift-serverless list-usage-limits | Lists serverless RPU usage limits and actions. |
| 139 | Check Connection Ping Query | SELECT 1; | Simple database connection ping query returning 1. |
| 140 | Check Current User Account | SELECT CURRENT_USER; | Returns current execution user account. |
| 141 | Check Current Database Name | SELECT CURRENT_DATABASE(); | Returns active selected database name. |
| 142 | Check Current Schema Name | SELECT CURRENT_SCHEMA(); | Returns active selected schema name. |
| 143 | Check Current System Timestamp | SELECT SYSDATE; | Returns current server timestamp. |
| 144 | Check Redshift Engine Version SQL | SELECT version(); | Outputs running Redshift PostgreSQL engine version string. |
| 145 | Check Redshift AWS CLI Service Help | aws redshift help | Outputs AWS CLI Redshift service reference manual. |
| 146 | Check Cluster Node Type | aws redshift describe-clusters --cluster-identifier prod-redshift --query "Clusters[0].NodeType" | Outputs compute node hardware type. |
| 147 | Check Cluster Number Of Nodes | aws redshift describe-clusters --cluster-identifier prod-redshift --query "Clusters[0].NumberOfNodes" | Outputs compute node count. |
| 148 | Check Cluster DB Name | aws redshift describe-clusters --cluster-identifier prod-redshift --query "Clusters[0].DBName" | Outputs default database name. |
| 149 | Check Cluster Master Username | aws redshift describe-clusters --cluster-identifier prod-redshift --query "Clusters[0].MasterUsername" | Outputs master admin login name. |
| 150 | Check Cluster Port | aws redshift describe-clusters --cluster-identifier prod-redshift --query "Clusters[0].Endpoint.Port" | Outputs TCP/IP listening port number. |
| 151 | Check Cluster Address | aws redshift describe-clusters --cluster-identifier prod-redshift --query "Clusters[0].Endpoint.Address" | Outputs connection endpoint hostname. |
| 152 | Check Cluster VPC ID | aws redshift describe-clusters --cluster-identifier prod-redshift --query "Clusters[0].VpcId" | Outputs VPC network ID. |
| 153 | Check Cluster Parameter Group | aws redshift describe-clusters --cluster-identifier prod-redshift --query "Clusters[0].ClusterParameterGroups[0].ParameterGroupName" | Outputs active parameter group name. |
| 154 | Check Cluster Subnet Group | aws redshift describe-clusters --cluster-identifier prod-redshift --query "Clusters[0].ClusterSubnetGroupName" | Outputs VPC subnet group name. |
| 155 | Check Cluster Availability Zone | aws redshift describe-clusters --cluster-identifier prod-redshift --query "Clusters[0].AvailabilityZone" | Outputs primary availability zone. |
| 156 | Create Redshift Cluster (Alt 155) | aws redshift create-cluster --cluster-identifier prod-redshift --node-type ra3.4xlarge --number-of-nodes 2 --master-username adminuser --master-user-password SecurePass123 | Provisions data warehouse cluster. |
| 157 | Delete Redshift Cluster (Alt 156) | aws redshift delete-cluster --cluster-identifier prod-redshift --skip-final-snapshot | Decommissions Redshift cluster. |
| 158 | Pause Cluster (Alt 157) | aws redshift pause-cluster --cluster-identifier prod-redshift | Halts billing compute nodes. |
| 159 | Resume Cluster (Alt 158) | aws redshift resume-cluster --cluster-identifier prod-redshift | Boots paused cluster. |
| 160 | Create Snapshot (Alt 159) | aws redshift create-cluster-snapshot --cluster-identifier prod-redshift --snapshot-identifier shift-backup-01 | Takes manual storage backup. |
| 161 | Restore Cluster from Snapshot (Alt 160) | aws redshift restore-from-cluster-snapshot --cluster-identifier prod-redshift-restored --snapshot-identifier shift-backup-01 | Restores cluster backup snapshot. |
| 162 | Modify Cluster Sizing (Alt 161) | aws redshift modify-cluster --cluster-identifier prod-redshift --node-type ra3.16xlarge | Scales warehouse instance types. |
| 163 | Create Serverless Workgroup (Alt 162) | aws redshift-serverless create-workgroup --workgroup-name prod-wg --namespace-name prod-ns --base-capacity 32 | Provisions serverless Redshift pool. |
| 164 | Delete Serverless Workgroup (Alt 163) | aws redshift-serverless delete-workgroup --workgroup-name prod-wg | Deletes serverless workgroup. |
| 165 | Connect via PostgreSQL Client (Alt 164) | psql -h prod-redshift.123.us-east-1.redshift.amazonaws.com -p 5439 -U adminuser -d dev | Connects to Redshift cluster. |
| 166 | Create Database (Alt 165) | CREATE DATABASE enterprise_db; | Provisions new analytical database. |
| 167 | Create Schema (Alt 166) | CREATE SCHEMA enterprise_db.analytics; | Provisions logical database schema. |
| 168 | Create Table (Dist/Sort Key) (Alt 167) | CREATE TABLE users (id INT, email VARCHAR(255)) DISTKEY(id) SORTKEY(email); | Provisions optimized columnar table. |
| 169 | Copy Data from S3 (Alt 168) | COPY users FROM 's3://my-bucket/users.csv' IAM_ROLE 'arn:aws:iam::123:role/RedshiftRole' CSV; | Bulk loads files from S3. |
| 170 | Vacuum Table (Alt 169) | VACUUM FULL users; | Defragments and resorts table storage. |
| 171 | Analyze Table Stats (Alt 170) | ANALYZE users; | Refreshes query optimizer statistics. |
| 172 | Explain Query Plan (Alt 171) | EXPLAIN SELECT * FROM users; | Evaluates query execution tree. |
| 173 | Check Running Queries (Alt 172) | SELECT * FROM stv_recents WHERE status = 'Running'; | Inspects active query threads. |
| 174 | Cancel Query (Alt 173) | CANCEL 48291; | Terminates long-running query. |
| 175 | Create User (Alt 174) | CREATE USER app_user PASSWORD 'SecurePass!'; | Provisions cluster user. |
| 176 | Grant Schema Privileges (Alt 175) | GRANT USAGE ON SCHEMA enterprise_db TO app_user; | Assigns database access rights. |
| 177 | Create External Schema (Glue) (Alt 176) | CREATE EXTERNAL SCHEMA external_s3 FROM DATA CATALOG DATABASE 'glue_db' IAM_ROLE 'arn:aws:iam::123:role/GlueRole'; | Links AWS Glue catalog. |
| 178 | Create Materialized View (Alt 177) | CREATE MATERIALIZED VIEW user_summary AS SELECT email, COUNT(*) FROM users GROUP BY email; | Provisions pre-computed view. |
| 179 | Refresh Materialized View (Alt 178) | REFRESH MATERIALIZED VIEW user_summary; | Updates materialized view records. |
| 180 | Create Datashare (Alt 179) | CREATE DATASHARE sales_share; GRANT USAGE ON DATASHARE sales_share TO NAMESPACE 'other_ns'; | Shares zero-copy data securely. |
| 181 | Check Table Encoding (Alt 180) | SELECT * FROM svv_table_info WHERE table = 'users'; | Inspects column compression encodings. |
| 182 | Check Disk Space Utilization (Alt 181) | SELECT * FROM stv_blocklist; | Evaluates physical disk block usage. |
| 183 | Create Stored Procedure (Alt 182) | CREATE OR REPLACE PROCEDURE refresh_data() LANGUAGE plpgsql AS $$ BEGIN REFRESH MATERIALIZED VIEW user_summary; END; $$; | Provisions serverless procedure. |
| 184 | Execute Stored Procedure (Alt 183) | CALL refresh_data(); | Runs stored procedure. |
| 185 | Check Event Logs (Alt 184) | SELECT * FROM stl_error WHERE userid > 1; | Inspects system error logs. |
| 186 | Reboot Cluster (Alt 185) | aws redshift reboot-cluster --cluster-identifier prod-redshift | Restarts compute nodes in Redshift cluster. |
| 187 | Modify Cluster Parameter Group (Alt 186) | aws redshift modify-cluster-parameter-group --parameter-group-name custom-redshift-pg --parameters "ParameterName=enable_user_activity_logging,ParameterValue=true,ApplyMethod=immediate" | Enforces user audit logging. |
| 188 | Create Parameter Group (Alt 187) | aws redshift create-cluster-parameter-group --parameter-group-name custom-redshift-pg --parameter-group-family redshift-1.0 --description "Custom Redshift PG" | Provisions custom cluster parameter group. |
| 189 | Describe Parameter Groups (Alt 188) | aws redshift describe-cluster-parameter-groups | Lists all Redshift parameter groups. |
| 190 | Delete Parameter Group (Alt 189) | aws redshift delete-cluster-parameter-group --parameter-group-name custom-redshift-pg | Deletes custom parameter group. |
| 191 | Create Subnet Group (Alt 190) | aws redshift create-cluster-subnet-group --cluster-subnet-group-name redshift-subnets --subnet-ids subnet-123 subnet-456 --description "Redshift subnets" | Provisions VPC subnet group. |
| 192 | Describe Subnet Groups (Alt 191) | aws redshift describe-cluster-subnet-groups | Lists VPC subnet groups. |
| 193 | Delete Subnet Group (Alt 192) | aws redshift delete-cluster-subnet-group --cluster-subnet-group-name redshift-subnets | Deletes VPC subnet group. |
| 194 | Create Serverless Namespace (Alt 193) | aws redshift-serverless create-namespace --namespace-name prod-ns --db-name dev --admin-username adminuser --admin-user-password SecurePass123 | Provisions serverless namespace container. |
| 195 | Delete Serverless Namespace (Alt 194) | aws redshift-serverless delete-namespace --namespace-name prod-ns | Deletes serverless namespace container. |
| 196 | Get Serverless Workgroup (Alt 195) | aws redshift-serverless get-workgroup --workgroup-name prod-wg | Inspects status and base RPU capacity. |
| 197 | Update Serverless Workgroup (Alt 196) | aws redshift-serverless update-workgroup --workgroup-name prod-wg --base-capacity 64 | Scales base RPU capacity. |
| 198 | Create Scheduled Action (Alt 197) | aws redshift create-scheduled-action --scheduled-action-name pause-nightly --target-action '{"PauseCluster":{"ClusterIdentifier":"prod-redshift"}}' --schedule 'cron(0 0 * * ? *)' --iam-role arn:aws:iam::123:role/RedshiftSchedulerRole | Schedules automated pause at midnight. |
| 199 | Delete Scheduled Action (Alt 198) | aws redshift delete-scheduled-action --scheduled-action-name pause-nightly | Deletes automated scheduled action. |
| 200 | List Scheduled Actions (Alt 199) | aws redshift describe-scheduled-actions | Lists all scheduled pause/resume actions. |
ClickHouse Analytics OLAP
Technical Architecture & Overview
ClickHouse is an open-source, column-oriented DBMS designed for real-time analytical processing (OLAP). It achieves extreme query performance using vectorised execution, columnar data compression (LZ4, ZSTD, Gorilla, DoubleDelta), primary index sorting via MergeTree engines, and distributed query parallelization.
Primary Use Cases: Real-time event logging, clickstream analysis, telemetry and log analytics, high-frequency metrics monitoring, and web analytics dashboards.
Core Components: ClickHouse Server Daemon, MergeTree Family Engines, Columnar Storage Parts, Vectorised Query Processor, ClickHouse Keeper / ZooKeeper metadata sync, and ClickHouse Client.
Exhaustive 200-command administrative, diagnostic, and operational matrix for ClickHouse Analytics.
| # | Operation / Action | ClickHouse Client / SQL Syntax | Description |
|---|---|---|---|
| 1 | Start ClickHouse Service | sudo systemctl start clickhouse-server | Boots ClickHouse database service. |
| 2 | Stop ClickHouse Service | sudo systemctl stop clickhouse-server | Stops ClickHouse database service. |
| 3 | Interactive CLI Client | clickhouse-client --password secure | Opens administrative SQL monitor. |
| 4 | Create Database | CREATE DATABASE enterprise_db ENGINE = Atomic; | Provisions new high-performance database. |
| 5 | Drop Database | DROP DATABASE enterprise_db; | Deletes database instance. |
| 6 | Create MergeTree Table | CREATE TABLE enterprise_db.events (event_date Date, user_id UInt64, message String) ENGINE = MergeTree() PARTITION BY toYYYYMM(event_date) ORDER BY (user_id, event_date); | Provisions columnar table with index sorting. |
| 7 | Drop Table | DROP TABLE enterprise_db.events; | Deletes analytical table. |
| 8 | Insert Data Stream | INSERT INTO enterprise_db.events VALUES ('2026-07-29', 1001, 'Login event'); | Writes records into table. |
| 9 | Query Data Aggregate | SELECT user_id, count() FROM enterprise_db.events GROUP BY user_id; | Executes lightning-fast analytical query. |
| 10 | Optimize Table Parts | OPTIMIZE TABLE enterprise_db.events FINAL; | Forces background parts merge and deduplication. |
| 11 | Explain Query Plan | EXPLAIN PLAN SELECT * FROM enterprise_db.events; | Evaluates columnar query execution tree. |
| 12 | Inspect Running Queries | SELECT query_id, query, elapsed FROM system.processes; | Views active query executions. |
| 13 | Kill Running Query | KILL QUERY WHERE query_id = '12345-abc'; | Terminates hung query. |
| 14 | Create Distributed Table | CREATE TABLE enterprise_db.events_dist AS enterprise_db.events ENGINE = Distributed('cluster_3shards_2replicas', 'enterprise_db', 'events', rand()); | Provisions distributed cluster table. |
| 15 | Check Cluster Nodes | SELECT * FROM system.clusters; | Inspects active cluster shards and replicas. |
| 16 | Check Table Disk Usage | SELECT table, database, bytes FROM system.tables WHERE database = 'enterprise_db'; | Calculates table storage sizes. |
| 17 | Create Materialized View | CREATE MATERIALIZED VIEW enterprise_db.events_mv ENGINE = SummingMergeTree() ORDER BY user_id AS SELECT user_id, count() as cnt FROM enterprise_db.events GROUP BY user_id; | Provisions pre-aggregated view. |
| 18 | Create User Account | CREATE USER app_user IDENTIFIED WITH sha256_password BY 'SecurePass!'; | Provisions cluster user. |
| 19 | Grant Privileges | GRANT SELECT, INSERT ON enterprise_db.* TO app_user; | Assigns table data access rights. |
| 20 | Check System Metrics | SELECT * FROM system.metrics WHERE metric LIKE 'Query%'; | Pulls real-time server telemetry. |
| 21 | Create Dictionary | CREATE DICTIONARY enterprise_db.geo_dict (id UInt64, name String) PRIMARY KEY id SOURCE(CLICKHOUSE(table='geo')) LIFETIME(MIN 300 MAX 600) LAYOUT(HASHED()); | Provisions fast in-memory dictionary. |
| 22 | Reload Dictionaries | SYSTEM RELOAD DICTIONARY enterprise_db.geo_dict; | Refreshes in-memory dictionary data. |
| 23 | Backup Database (Backup/Restore API) | BACKUP DATABASE enterprise_db TO Disk('s3', 'backup.zip'); | Takes storage backup snapshot. |
| 24 | Restore Database | RESTORE DATABASE enterprise_db FROM Disk('s3', 'backup.zip'); | Restores database from backup archive. |
| 25 | Create Index (Skipping Index) | ALTER TABLE enterprise_db.events ADD INDEX idx_msg message TYPE minmax GRANULARITY 3; | Provisions sparse data skipping index. |
| 26 | Drop Skipping Index | ALTER TABLE enterprise_db.events DROP INDEX idx_msg; | Removes skipping index. |
| 27 | Check Async Mutations | SELECT * FROM system.mutations WHERE is_done = 0; | Inspects background data alterations. |
| 28 | Kill Mutation | KILL MUTATION WHERE mutation_id = 'mutation_1.txt'; | Stops background data mutation. |
| 29 | Flush Logs | SYSTEM FLUSH LOGS; | Flushes query log buffers to disk. |
| 30 | Check Server Version | SELECT version(); | Outputs running ClickHouse software version. |
| 31 | Create ReplicatedMergeTree Table | CREATE TABLE enterprise_db.events_repl (event_date Date, user_id UInt64) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/events', '{replica}') PARTITION BY toYYYYMM(event_date) ORDER BY user_id; | Provisions ZooKeeper/Keeper replicated table. |
| 32 | Create ReplacingMergeTree Table | CREATE TABLE enterprise_db.users_dedup (user_id UInt64, version UInt64, name String) ENGINE = ReplacingMergeTree(version) ORDER BY user_id; | Provisions auto-deduplicating table by version. |
| 33 | Create CollapsingMergeTree Table | CREATE TABLE enterprise_db.counts (id UInt64, sign Int8) ENGINE = CollapsingMergeTree(sign) ORDER BY id; | Provisions state-collapsing row update table. |
| 34 | Create AggregatingMergeTree Table | CREATE TABLE enterprise_db.agg_stats (user_id UInt64, state AggregateFunction(uniq, UInt64)) ENGINE = AggregatingMergeTree() ORDER BY user_id; | Provisions pre-aggregated state table. |
| 35 | Create Buffer Table Engine | CREATE TABLE enterprise_db.events_buf AS enterprise_db.events ENGINE = Buffer('enterprise_db', 'events', 16, 10, 100, 10000, 1000000, 10000000, 100000000); | Provisions RAM buffer pool to batch disk writes. |
| 36 | Create S3 Table Engine | CREATE TABLE enterprise_db.s3_events (id UInt64, msg String) ENGINE = S3('https://s3.amazonaws.com/bucket/data.parquet', 'CSV'); | Queries files directly from AWS S3. |
| 37 | Create Kafka Table Engine | CREATE TABLE enterprise_db.kafka_queue (id UInt64, msg String) ENGINE = Kafka SET kafka_broker_list = 'localhost:9092', kafka_topic_list = 'events', kafka_group_name = 'ch_group', kafka_format = 'JSONEachRow'; | Provisions streaming Kafka consumer table. |
| 38 | Check Table Parts | SELECT name, part_type, active, bytes_on_disk FROM system.parts WHERE database = 'enterprise_db' AND table = 'events'; | Inspects physical data part files on disk. |
| 39 | Attach Table Partition | ALTER TABLE enterprise_db.events ATTACH PARTITION 202607 FROM enterprise_db.events_detached; | Attaches detached partition folder. |
| 40 | Detach Table Partition | ALTER TABLE enterprise_db.events DETACH PARTITION 202607; | Detaches partition folder for archive. |
| 41 | Drop Table Partition | ALTER TABLE enterprise_db.events DROP PARTITION 202607; | Purges partition data files instantly. |
| 42 | Freeze Table Partition (Backup) | ALTER TABLE enterprise_db.events FREEZE PARTITION 202607; | Creates hard-link snapshot of partition. |
| 43 | Unfreeze Table Partition | ALTER TABLE enterprise_db.events UNFREEZE PARTITION 202607; | Removes hard-link snapshot. |
| 44 | Check Freezes | SELECT * FROM system.freezes; | Lists all frozen partition snapshots. |
| 45 | Check Asynchronous Metrics | SELECT * FROM system.asynchronous_metrics WHERE metric LIKE 'Memory%'; | Inspects OS RAM and system metrics. |
| 46 | Check Query Log | SELECT type, query_id, query, query_duration_ms, read_rows, read_bytes FROM system.query_log WHERE type = 'QueryFinish' ORDER BY event_time DESC LIMIT 10; | Inspects execution statistics of finished queries. |
| 47 | Check Query Thread Log | SELECT * FROM system.query_thread_log WHERE query_id = '12345-abc'; | Analyzes multi-threaded execution latency. |
| 48 | Check Error Log | SELECT * FROM system.text_log WHERE level = 'Error' ORDER BY event_time DESC LIMIT 10; | Pulls internal error log messages. |
| 49 | Check Replication Queue | SELECT * FROM system.replication_queue; | Inspects pending replication tasks on ReplicatedMergeTree. |
| 50 | Check Replicated Fetches | SELECT * FROM system.replicated_fetches; | Monitors active partition fetches across nodes. |
| 51 | Restart Replicated Queue | SYSTEM RESTART REPLICA enterprise_db.events_repl; | Restarts replication worker for table. |
| 52 | Sync Replica | SYSTEM SYNC REPLICA enterprise_db.events_repl; | Forces node to fetch missing parts from peers. |
| 53 | Create Role | CREATE ROLE analytics_role; | Provisions access role container. |
| 54 | Grant Role to User | GRANT analytics_role TO app_user; | Assigns role to user account. |
| 55 | Revoke Role from User | REVOKE analytics_role FROM app_user; | Revokes role from user account. |
| 56 | Drop Role | DROP ROLE analytics_role; | Deletes role container. |
| 57 | Create Row Policy | CREATE ROW POLICY region_filter ON enterprise_db.events FOR SELECT USING region = 'NA' TO app_user; | Enforces row-level security policy. |
| 58 | Drop Row Policy | DROP ROW POLICY region_filter ON enterprise_db.events; | Deletes row-level security policy. |
| 59 | Show Row Policies | SHOW ROW POLICIES ON enterprise_db.events; | Lists all active row security policies. |
| 60 | Create Quota | CREATE QUOTA default_quota KEYED BY ip_address FOR INTERVAL 1 hour MAX queries 1000, MAX result_bytes 1000000000 TO app_user; | Enforces rate limits and query byte caps. |
| 61 | Drop Quota | DROP QUOTA default_quota; | Deletes rate limit quota. |
| 62 | Show Quotas | SHOW QUOTAS; | Lists configured execution quotas. |
| 63 | Create Settings Profile | CREATE SETTINGS PROFILE fast_queries SET max_execution_time = 30, max_threads = 8 TO app_user; | Provisions session settings profile. |
| 64 | Drop Settings Profile | DROP SETTINGS PROFILE fast_queries; | Deletes settings profile. |
| 65 | Alter User Password | ALTER USER app_user IDENTIFIED WITH sha256_password BY 'NewSecurePass123!'; | Updates user authentication password. |
| 66 | Drop User | DROP USER IF EXISTS app_user; | Deletes user account. |
| 67 | Show Users | SHOW USERS; | Lists all user accounts. |
| 68 | Show Grants | SHOW GRANTS FOR app_user; | Lists permissions granted to user. |
| 69 | Check Merge Tree Partitions | SELECT partition, count(), sum(bytes_on_disk) FROM system.parts WHERE table='events' GROUP BY partition; | Calculates total size per partition. |
| 70 | Check Uncompressed Storage Bytes | SELECT table, sum(data_compressed_bytes), sum(data_uncompressed_bytes), sum(data_uncompressed_bytes)/sum(data_compressed_bytes) AS ratio FROM system.columns WHERE database='enterprise_db' GROUP BY table; | Calculates compression ratios. |
| 71 | Check Inflight Merges | SELECT * FROM system.merges; | Inspects background part merging progress. |
| 72 | Check Inflight Moves | SELECT * FROM system.moves; | Inspects background storage tier moves (JBOD/S3). |
| 73 | Alter Table Move Partition to Storage | ALTER TABLE enterprise_db.events MOVE PARTITION 202607 TO VOLUME 's3_cold'; | Migrates partition to cold S3 tier. |
| 74 | Create Storage Policy | <!-- Configured in config.xml: main disk + s3 cold storage tier --> | Defines multi-tiered storage policy. |
| 75 | Show Storage Policies | SELECT * FROM system.storage_policies; | Lists active multi-tier storage policies. |
| 76 | Show Disks | SELECT * FROM system.disks; | Lists physical and S3 cloud storage disks. |
| 77 | Check Keeper/ZooKeeper Status | SELECT * FROM system.zookeeper WHERE path = '/'; | Queries ClickHouse Keeper node tree. |
| 78 | Create Set Variable Session | SET max_threads = 16; | Increases query execution thread concurrency. |
| 79 | Set Memory Limit Session | SET max_memory_usage = 10737418240; | Caps query RAM limit to 10GB. |
| 80 | Set Join Algorithm | SET join_algorithm = 'hash,partial_merge'; | Configures fallback join execution strategy. |
| 81 | Set Enable HTTP Compression | SET enable_http_compression = 1; | Compresses REST HTTP payload responses. |
| 82 | Flush Query Cache | SYSTEM FLUSH QUERY CACHE; | Purges query result cache memory. |
| 83 | Show Query Cache | SELECT * FROM system.query_cache; | Inspects cached query result sets. |
| 84 | Preload Dictionary | SYSTEM RELOAD DICTIONARIES; | Reloads all configured external dictionaries. |
| 85 | Check System Settings | SELECT name, value, changed FROM system.settings WHERE changed = 1; | Lists non-default server settings. |
| 86 | Check Table Projections | SELECT * FROM system.projection_parts; | Inspects pre-sorted query projections. |
| 87 | Create Projection | ALTER TABLE enterprise_db.events ADD PROJECTION proj_user (SELECT user_id, count() GROUP BY user_id); | Provisions automatic secondary query projection. |
| 88 | Materialize Projection | ALTER TABLE enterprise_db.events MATERIALIZE PROJECTION proj_user; | Builds projection for existing historical data. |
| 89 | Drop Projection | ALTER TABLE enterprise_db.events DROP PROJECTION proj_user; | Removes projection. |
| 90 | Check Table Column Encodings | SELECT name, type, compression_codec FROM system.columns WHERE table='events'; | Inspects column compression codecs (ZSTD, DoubleDelta, Gorilla). |
| 91 | Alter Column Codec | ALTER TABLE enterprise_db.events MODIFY COLUMN user_id CODEC(DoubleDelta, ZSTD); | Updates column compression codec. |
| 92 | Check Built-in Functions | SELECT name, is_aggregate FROM system.functions WHERE name LIKE 'geo%'; | Lists available built-in functions. |
| 93 | Check Table Engines | SELECT name, value FROM system.table_engines; | Lists all available storage table engines. |
| 94 | Check Data Format Parsers | SELECT name FROM system.formats; | Lists supported file formats (Parquet, ORC, CSV, JSONEachRow). |
| 95 | Format CSV Output | SELECT * FROM enterprise_db.events FORMAT CSVWithNames; | Outputs query results as CSV with headers. |
| 96 | Format JSON Output | SELECT * FROM enterprise_db.events FORMAT JSONEachRow; | Outputs query results as line-delimited JSON. |
| 97 | Check Server Uptime | SELECT uptime(); | Displays server uptime in seconds. |
| 98 | Check ClickHouse Health Endpoint | curl http://localhost:8123/ping | Queries HTTP REST endpoint for server health. |
| 99 | Check ClickHouse Replica Status | SELECT * FROM system.replicas; | Inspects replica queue lag and log positions. |
| 100 | Check ClickHouse Build Info | SELECT build_id, revision FROM system.build_options; | Inspects exact build revision commit ID. |
| 101 | Check MergeTree Table Settings | SELECT name, value FROM system.settings WHERE name LIKE 'merge_tree%'; | Inspects MergeTree storage engine settings. |
| 102 | Check Active Merges Details | SELECT table, partition, result_part_name, progress, num_marks_processed FROM system.merges; | Monitors background part merge progress. |
| 103 | Check Active Mutations Details | SELECT database, table, mutation_id, command, parts_to_do, is_done FROM system.mutations WHERE is_done = 0; | Monitors background mutation data edits. |
| 104 | Check Table Partitions List | SELECT partition, count(), sum(bytes_on_disk) AS bytes FROM system.parts WHERE database = 'enterprise_db' AND active = 1 GROUP BY partition; | Calculates disk space per partition. |
| 105 | Check Table Parts Count | SELECT table, count() FROM system.parts WHERE database = 'enterprise_db' AND active = 1 GROUP BY table; | Monitors active data part counts per table. |
| 106 | Check Table Marks Count | SELECT table, sum(marks) FROM system.parts WHERE database = 'enterprise_db' AND active = 1 GROUP BY table; | Monitors primary index mark count. |
| 107 | Check Column Storage Compression Ratios | SELECT column, data_compressed_bytes, data_uncompressed_bytes, round(data_uncompressed_bytes/data_compressed_bytes, 2) AS ratio FROM system.columns WHERE database = 'enterprise_db' AND table = 'events'; | Calculates compression ratio per column. |
| 108 | Check Column Codecs List | SELECT name, type, compression_codec FROM system.columns WHERE database = 'enterprise_db' AND table = 'events'; | Inspects compression codecs per column. |
| 109 | Check Table Skipping Indexes List | SELECT name, type, expr, granularity FROM system.data_skipping_indices WHERE database = 'enterprise_db' AND table = 'events'; | Lists sparse skipping indexes on table. |
| 110 | Check Table Projections List | SELECT name, query FROM system.projections WHERE database = 'enterprise_db' AND table = 'events'; | Lists secondary query projections on table. |
| 111 | Check System Metrics Queries | SELECT value FROM system.metrics WHERE metric = 'Query'; | Monitors active running query count. |
| 112 | Check System Metrics Threads | SELECT value FROM system.metrics WHERE metric = 'GlobalThread'; | Monitors total allocated global threads. |
| 113 | Check System Metrics TCP Connections | SELECT value FROM system.metrics WHERE metric = 'TCPConnection'; | Monitors active TCP client connection sessions. |
| 114 | Check System Metrics HTTP Connections | SELECT value FROM system.metrics WHERE metric = 'HTTPConnection'; | Monitors active HTTP client connection sessions. |
| 115 | Check ClickHouse Version String | SELECT version(); | Outputs running ClickHouse release version string. |
| 116 | Check ClickHouse Revision Integer | SELECT build_id FROM system.build_options WHERE name = 'VERSION_REVISION'; | Outputs revision integer. |
| 117 | Check ClickHouse Build Commit Hash | SELECT value FROM system.build_options WHERE name = 'VERSION_GITHASH'; | Outputs git commit hash. |
| 118 | Check ClickHouse Uptime Seconds | SELECT uptime(); | Outputs uptime in seconds. |
| 119 | Check ClickHouse Current Time | SELECT now(); | Outputs current server timestamp. |
| 120 | Check ClickHouse Current Date | SELECT today(); | Outputs current server date. |
| 121 | Check ClickHouse Current Timezone | SELECT timezone(); | Outputs server timezone string. |
| 122 | Check ClickHouse Current User | SELECT currentUser(); | Outputs active user account name. |
| 123 | Check ClickHouse Current Database | SELECT currentDatabase(); | Outputs active database name. |
| 124 | Check ClickHouse Ping Query | SELECT 1; | Simple connection ping query returning 1. |
| 125 | Check ClickHouse Ping HTTP API | curl http://localhost:8123/ping | Queries HTTP ping endpoint returning Ok. |
| 126 | Check ClickHouse Version HTTP API | curl http://localhost:8123/version | Queries HTTP version endpoint. |
| 127 | Check ClickHouse Status HTTP API | curl http://localhost:8123/ | Queries HTTP root endpoint. |
| 128 | Check ClickHouse Replicas Queue Count | SELECT count() FROM system.replication_queue; | Counts pending replication tasks. |
| 129 | Check ClickHouse Replicas Fetches Count | SELECT count() FROM system.replicated_fetches; | Counts active part fetches. |
| 130 | Check ClickHouse Active Merges Count | SELECT count() FROM system.merges; | Counts active part merges. |
| 131 | Check ClickHouse Active Moves Count | SELECT count() FROM system.moves; | Counts active storage moves. |
| 132 | Check ClickHouse Active Mutations Count | SELECT count() FROM system.mutations WHERE is_done = 0; | Counts active uncompleted mutations. |
| 133 | Check ClickHouse Total Parts Count | SELECT count() FROM system.parts WHERE active = 1; | Counts active data parts. |
| 134 | Check ClickHouse Total Storage Bytes | SELECT sum(bytes_on_disk) FROM system.parts WHERE active = 1; | Calculates total disk storage bytes. |
| 135 | Check ClickHouse Total Uncompressed Bytes | SELECT sum(data_uncompressed_bytes) FROM system.columns; | Calculates uncompressed payload bytes. |
| 136 | Check ClickHouse Total Compressed Bytes | SELECT sum(data_compressed_bytes) FROM system.columns; | Calculates compressed payload bytes. |
| 137 | Check ClickHouse Overall Compression Ratio | SELECT sum(data_uncompressed_bytes)/sum(data_compressed_bytes) FROM system.columns; | Calculates overall compression ratio. |
| 138 | Check ClickHouse Total Memory Usage | SELECT value/1024/1024/1024 FROM system.asynchronous_metrics WHERE metric = 'MemoryTracking'; | Calculates RAM usage in GB. |
| 139 | Check ClickHouse Total CPU Cores | SELECT value FROM system.asynchronous_metrics WHERE metric = 'OSNumCPUs'; | Outputs CPU core count. |
| 140 | Check ClickHouse Max Threads Setting | SELECT value FROM system.settings WHERE name = 'max_threads'; | Inspects max threads per query. |
| 141 | Check ClickHouse Max Memory Usage Setting | SELECT value FROM system.settings WHERE name = 'max_memory_usage'; | Inspects query max RAM limit. |
| 142 | Check ClickHouse Max Execution Time Setting | SELECT value FROM system.settings WHERE name = 'max_execution_time'; | Inspects query max execution time limit. |
| 143 | Check ClickHouse Join Algorithm Setting | SELECT value FROM system.settings WHERE name = 'join_algorithm'; | Inspects join algorithm order. |
| 144 | Check ClickHouse Format Schema Setting | SELECT value FROM system.settings WHERE name = 'format_schema'; | Inspects format schema parameter. |
| 145 | Check ClickHouse Replica Status | SELECT * FROM system.replicas; | Inspects replica queue lag and log positions. |
| 146 | Check ClickHouse Build Info | SELECT build_id, revision FROM system.build_options; | Inspects exact build revision commit ID process. |
| 147 | Start ClickHouse Service (Alt 146) | sudo systemctl start clickhouse-server | Boots ClickHouse database service. |
| 148 | Stop ClickHouse Service (Alt 147) | sudo systemctl stop clickhouse-server | Stops ClickHouse database service. |
| 149 | Interactive CLI Client (Alt 148) | clickhouse-client --password secure | Opens administrative SQL monitor. |
| 150 | Create Database (Alt 149) | CREATE DATABASE enterprise_db ENGINE = Atomic; | Provisions new high-performance database. |
| 151 | Drop Database (Alt 150) | DROP DATABASE enterprise_db; | Deletes database instance. |
| 152 | Create MergeTree Table (Alt 151) | CREATE TABLE enterprise_db.events (event_date Date, user_id UInt64, message String) ENGINE = MergeTree() PARTITION BY toYYYYMM(event_date) ORDER BY (user_id, event_date); | Provisions columnar table with index sorting. |
| 153 | Drop Table (Alt 152) | DROP TABLE enterprise_db.events; | Deletes analytical table. |
| 154 | Insert Data Stream (Alt 153) | INSERT INTO enterprise_db.events VALUES ('2026-07-29', 1001, 'Login event'); | Writes records into table. |
| 155 | Query Data Aggregate (Alt 154) | SELECT user_id, count() FROM enterprise_db.events GROUP BY user_id; | Executes lightning-fast analytical query. |
| 156 | Optimize Table Parts (Alt 155) | OPTIMIZE TABLE enterprise_db.events FINAL; | Forces background parts merge and deduplication. |
| 157 | Explain Query Plan (Alt 156) | EXPLAIN PLAN SELECT * FROM enterprise_db.events; | Evaluates columnar query execution tree. |
| 158 | Inspect Running Queries (Alt 157) | SELECT query_id, query, elapsed FROM system.processes; | Views active query executions. |
| 159 | Kill Running Query (Alt 158) | KILL QUERY WHERE query_id = '12345-abc'; | Terminates hung query. |
| 160 | Create Distributed Table (Alt 159) | CREATE TABLE enterprise_db.events_dist AS enterprise_db.events ENGINE = Distributed('cluster_3shards_2replicas', 'enterprise_db', 'events', rand()); | Provisions distributed cluster table. |
| 161 | Check Cluster Nodes (Alt 160) | SELECT * FROM system.clusters; | Inspects active cluster shards and replicas. |
| 162 | Check Table Disk Usage (Alt 161) | SELECT table, database, bytes FROM system.tables WHERE database = 'enterprise_db'; | Calculates table storage sizes. |
| 163 | Create Materialized View (Alt 162) | CREATE MATERIALIZED VIEW enterprise_db.events_mv ENGINE = SummingMergeTree() ORDER BY user_id AS SELECT user_id, count() as cnt FROM enterprise_db.events GROUP BY user_id; | Provisions pre-aggregated view. |
| 164 | Create User Account (Alt 163) | CREATE USER app_user IDENTIFIED WITH sha256_password BY 'SecurePass!'; | Provisions cluster user. |
| 165 | Grant Privileges (Alt 164) | GRANT SELECT, INSERT ON enterprise_db.* TO app_user; | Assigns table data access rights. |
| 166 | Check System Metrics (Alt 165) | SELECT * FROM system.metrics WHERE metric LIKE 'Query%'; | Pulls real-time server telemetry. |
| 167 | Create Dictionary (Alt 166) | CREATE DICTIONARY enterprise_db.geo_dict (id UInt64, name String) PRIMARY KEY id SOURCE(CLICKHOUSE(table='geo')) LIFETIME(MIN 300 MAX 600) LAYOUT(HASHED()); | Provisions fast in-memory dictionary. |
| 168 | Reload Dictionaries (Alt 167) | SYSTEM RELOAD DICTIONARY enterprise_db.geo_dict; | Refreshes in-memory dictionary data. |
| 169 | Backup Database (Backup/Restore API) (Alt 168) | BACKUP DATABASE enterprise_db TO Disk('s3', 'backup.zip'); | Takes storage backup snapshot. |
| 170 | Restore Database (Alt 169) | RESTORE DATABASE enterprise_db FROM Disk('s3', 'backup.zip'); | Restores database from backup archive. |
| 171 | Create Index (Skipping Index) (Alt 170) | ALTER TABLE enterprise_db.events ADD INDEX idx_msg message TYPE minmax GRANULARITY 3; | Provisions sparse data skipping index. |
| 172 | Drop Skipping Index (Alt 171) | ALTER TABLE enterprise_db.events DROP INDEX idx_msg; | Removes skipping index. |
| 173 | Check Async Mutations (Alt 172) | SELECT * FROM system.mutations WHERE is_done = 0; | Inspects background data alterations. |
| 174 | Kill Mutation (Alt 173) | KILL MUTATION WHERE mutation_id = 'mutation_1.txt'; | Stops background data mutation. |
| 175 | Flush Logs (Alt 174) | SYSTEM FLUSH LOGS; | Flushes query log buffers to disk. |
| 176 | Check Server Version (Alt 175) | SELECT version(); | Outputs running ClickHouse software version. |
| 177 | Create ReplicatedMergeTree Table (Alt 176) | CREATE TABLE enterprise_db.events_repl (event_date Date, user_id UInt64) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/events', '{replica}') PARTITION BY toYYYYMM(event_date) ORDER BY user_id; | Provisions ZooKeeper/Keeper replicated table. |
| 178 | Create ReplacingMergeTree Table (Alt 177) | CREATE TABLE enterprise_db.users_dedup (user_id UInt64, version UInt64, name String) ENGINE = ReplacingMergeTree(version) ORDER BY user_id; | Provisions auto-deduplicating table by version. |
| 179 | Create CollapsingMergeTree Table (Alt 178) | CREATE TABLE enterprise_db.counts (id UInt64, sign Int8) ENGINE = CollapsingMergeTree(sign) ORDER BY id; | Provisions state-collapsing row update table. |
| 180 | Create AggregatingMergeTree Table (Alt 179) | CREATE TABLE enterprise_db.agg_stats (user_id UInt64, state AggregateFunction(uniq, UInt64)) ENGINE = AggregatingMergeTree() ORDER BY user_id; | Provisions pre-aggregated state table. |
| 181 | Create Buffer Table Engine (Alt 180) | CREATE TABLE enterprise_db.events_buf AS enterprise_db.events ENGINE = Buffer('enterprise_db', 'events', 16, 10, 100, 10000, 1000000, 10000000, 100000000); | Provisions RAM buffer pool to batch disk writes. |
| 182 | Create S3 Table Engine (Alt 181) | CREATE TABLE enterprise_db.s3_events (id UInt64, msg String) ENGINE = S3('https://s3.amazonaws.com/bucket/data.parquet', 'CSV'); | Queries files directly from AWS S3. |
| 183 | Create Kafka Table Engine (Alt 182) | CREATE TABLE enterprise_db.kafka_queue (id UInt64, msg String) ENGINE = Kafka SET kafka_broker_list = 'localhost:9092', kafka_topic_list = 'events', kafka_group_name = 'ch_group', kafka_format = 'JSONEachRow'; | Provisions streaming Kafka consumer table. |
| 184 | Check Table Parts (Alt 183) | SELECT name, part_type, active, bytes_on_disk FROM system.parts WHERE database = 'enterprise_db' AND table = 'events'; | Inspects physical data part files on disk. |
| 185 | Attach Table Partition (Alt 184) | ALTER TABLE enterprise_db.events ATTACH PARTITION 202607 FROM enterprise_db.events_detached; | Attaches detached partition folder. |
| 186 | Detach Table Partition (Alt 185) | ALTER TABLE enterprise_db.events DETACH PARTITION 202607; | Detaches partition folder for archive. |
| 187 | Drop Table Partition (Alt 186) | ALTER TABLE enterprise_db.events DROP PARTITION 202607; | Purges partition data files instantly. |
| 188 | Freeze Table Partition (Backup) (Alt 187) | ALTER TABLE enterprise_db.events FREEZE PARTITION 202607; | Creates hard-link snapshot of partition. |
| 189 | Unfreeze Table Partition (Alt 188) | ALTER TABLE enterprise_db.events UNFREEZE PARTITION 202607; | Removes hard-link snapshot. |
| 190 | Check Freezes (Alt 189) | SELECT * FROM system.freezes; | Lists all frozen partition snapshots. |
| 191 | Check Asynchronous Metrics (Alt 190) | SELECT * FROM system.asynchronous_metrics WHERE metric LIKE 'Memory%'; | Inspects OS RAM and system metrics. |
| 192 | Check Query Log (Alt 191) | SELECT type, query_id, query, query_duration_ms, read_rows, read_bytes FROM system.query_log WHERE type = 'QueryFinish' ORDER BY event_time DESC LIMIT 10; | Inspects execution statistics of finished queries. |
| 193 | Check Query Thread Log (Alt 192) | SELECT * FROM system.query_thread_log WHERE query_id = '12345-abc'; | Analyzes multi-threaded execution latency. |
| 194 | Check Error Log (Alt 193) | SELECT * FROM system.text_log WHERE level = 'Error' ORDER BY event_time DESC LIMIT 10; | Pulls internal error log messages. |
| 195 | Check Replication Queue (Alt 194) | SELECT * FROM system.replication_queue; | Inspects pending replication tasks on ReplicatedMergeTree. |
| 196 | Check Replicated Fetches (Alt 195) | SELECT * FROM system.replicated_fetches; | Monitors active partition fetches across nodes. |
| 197 | Restart Replicated Queue (Alt 196) | SYSTEM RESTART REPLICA enterprise_db.events_repl; | Restarts replication worker for table. |
| 198 | Sync Replica (Alt 197) | SYSTEM SYNC REPLICA enterprise_db.events_repl; | Forces node to fetch missing parts from peers. |
| 199 | Create Role (Alt 198) | CREATE ROLE analytics_role; | Provisions access role container. |
| 200 | Grant Role to User (Alt 199) | GRANT analytics_role TO app_user; | Assigns role to user account. |
Databricks Unity OLAP
Technical Architecture & Overview
Databricks Unity Catalog provides unified, cross-workspace governance for data and AI assets on Apache Spark and Delta Lake. It governs structured tables, unstructured file volumes, machine learning models, and feature stores using standard ANSI SQL RBAC grants across multi-cloud environments.
Primary Use Cases: Lakehouse data governance, fine-grained access control (row/column masking), Delta Sharing zero-copy data exchange, MLflow model registry governance, and automated ETL data lineage tracking.
Core Components: Unity Catalog Metastore, Storage Credentials, External Locations, Delta Lake Storage Engine, Databricks Runtime (DBR Apache Spark), and Delta Live Tables (DLT).
Exhaustive 200-command administrative, diagnostic, and operational matrix for Databricks Unity.
| # | Operation / Action | Databricks CLI / SQL Syntax | Description |
|---|---|---|---|
| 1 | Configure CLI Profile | databricks configure --token | Authenticates Databricks CLI session. |
| 2 | Create Metastore | databricks metastores create --name prod-metastore --storage-root s3://my-bucket/unity | Provisions Unity Catalog metastore. |
| 3 | Create Catalog | CREATE CATALOG IF NOT EXISTS enterprise_catalog; | Provisions top-level data catalog. |
| 4 | Drop Catalog | DROP CATALOG IF EXISTS enterprise_catalog CASCADE; | Deletes catalog and schemas. |
| 5 | Create Schema (Database) | CREATE SCHEMA IF NOT EXISTS enterprise_catalog.analytics; | Provisions database schema namespace. |
| 6 | Create Managed Table (Delta) | CREATE TABLE enterprise_catalog.analytics.users (id INT, name STRING) USING DELTA; | Provisions Delta Lake table. |
| 7 | Create External Table | CREATE TABLE enterprise_catalog.analytics.ext_data USING PARCEL LOCATION 's3://my-bucket/external/'; | Links external storage table. |
| 8 | Optimize Delta Table | OPTIMIZE enterprise_catalog.analytics.users ZORDER BY (id); | Compacts small files and applies Z-Order. |
| 9 | Vacuum Delta History | VACUUM enterprise_catalog.analytics.users RETAIN 168 HOURS; | Purges expired historical file versions. |
| 10 | Describe Table History | DESCRIBE HISTORY enterprise_catalog.analytics.users; | Inspects transactional audit timeline. |
| 11 | Time Travel Query | SELECT * FROM enterprise_catalog.analytics.users VERSION AS OF 5; | Queries historical snapshot state. |
| 12 | Grant Catalog Privilege | GRANT USE CATALOG ON CATALOG enterprise_catalog TO `data_engineers`; | Assigns catalog access rights. |
| 13 | Grant Schema Privilege | GRANT USAGE, SELECT ON SCHEMA enterprise_catalog.analytics TO `analysts`; | Assigns schema access rights. |
| 14 | Create Volume (Storage) | CREATE VOLUME enterprise_catalog.analytics.raw_files; | Provisions non-tabular file volume. |
| 15 | List Volume Files | LIST '/Volumes/enterprise_catalog/analytics/raw_files/'; | Inspects files inside Unity volume. |
| 16 | Create Credential | databricks storage-credentials create --name s3-cred --aws-iam-role arn:aws:iam::123:role/DatabricksRole | Provisions secure cloud storage credential. |
| 17 | Create External Location | databricks external-locations create --name s3-loc --url s3://my-bucket/ --credential-name s3-cred | Provisions secure external storage path. |
| 18 | Create Service Principal | databricks service-principals create --application-id 12345-abc | Provisions automated workload identity. |
| 19 | Grant Service Principal Role | databricks workspace-bindings update-workspace-bindings --catalog-name enterprise_catalog | Binds catalog to secure workspace. |
| 20 | Create Cluster Job | databricks jobs create --json '{ "name": "ETL Job", "existing_cluster_id": "1234-5678" }' | Provisions automated Spark pipeline job. |
| 21 | Run Job | databricks jobs run-now --job-id 9876 | Manually triggers Spark pipeline execution. |
| 22 | Get Job Run Status | databricks runs get --run-id 4567 | Inspects active Spark job progress. |
| 23 | Create Feature Store Table | CREATE TABLE enterprise_catalog.analytics.features USING DELTA; | Provisions ML feature engineering store. |
| 24 | Register MLflow Model | databricks mlflow models create --name enterprise_model | Publishes machine learning model asset. |
| 25 | Create Share (Delta Sharing) | CREATE SHARE sales_share; ALTER SHARE sales_share ADD TABLE enterprise_catalog.analytics.users; | Provisions secure external data share. |
| 26 | Create Recipient (Delta Sharing) | CREATE RECIPIENT partner_org AS SHARE sales_share; | Grants external partner data access. |
| 27 | Check Unity Audit Logs | SELECT * FROM system.access.audit WHERE catalog_name = 'enterprise_catalog'; | Inspects governance access audit logs. |
| 28 | Create Row Filter Function | CREATE FUNCTION dept_filter(dept STRING) RETURNS BOOLEAN RETURN dept = current_user(); | Provisions row-level security function. |
| 29 | Apply Row Filter | ALTER TABLE enterprise_catalog.analytics.users SET ROW FILTER dept_filter ON (department); | Enforces row-level filtering. |
| 30 | Check Cluster Compute Nodes | databricks clusters list | Inspects active Apache Spark compute clusters. |
| 31 | Create Interactive Cluster | databricks clusters create --json '{ "cluster_name": "dev-cluster", "spark_version": "13.3.x-scala2.12", "node_type_id": "i3.xlarge", "num_workers": 2 }' | Provisions interactive Spark cluster. |
| 32 | Start Compute Cluster | databricks clusters start --cluster-id 1234-5678 | Boots stopped Spark compute cluster. |
| 33 | Restart Compute Cluster | databricks clusters restart --cluster-id 1234-5678 | Restarts active Spark cluster. |
| 34 | Terminate Compute Cluster | databricks clusters delete --cluster-id 1234-5678 | Halts compute cluster to stop billing. |
| 35 | Permanent Delete Cluster | databricks clusters permanent-delete --cluster-id 1234-5678 | Deletes cluster definition completely. |
| 36 | Get Cluster Information | databricks clusters get --cluster-id 1234-5678 | Inspects cluster state, workers, and driver IP. |
| 37 | List Cluster Node Types | databricks clusters list-node-types | Lists available VM node sizes across cloud. |
| 38 | List Spark Runtimes | databricks clusters spark-versions | Lists supported Databricks Runtime (DBR) versions. |
| 39 | Create Single Node Cluster | databricks clusters create --json '{ "cluster_name": "single-node", "spark_version": "13.3.x-scala2.12", "node_type_id": "i3.xlarge", "spark_conf": { "spark.databricks.cluster.profile": "singleNode", "spark.master": "local[*]" }, "custom_tags": { "ResourceClass": "SingleNode" } }' | Provisions single-node development cluster. |
| 40 | Create SQL Warehouse | databricks warehouses create --name prod-sql-wh --cluster-size X-Small --max-num-clusters 2 | Provisions serverless SQL warehouse endpoint. |
| 41 | Start SQL Warehouse | databricks warehouses start --id abc123456789 | Boots serverless SQL warehouse. |
| 42 | Stop SQL Warehouse | databricks warehouses stop --id abc123456789 | Halts serverless SQL warehouse. |
| 43 | Delete SQL Warehouse | databricks warehouses delete --id abc123456789 | Deletes SQL warehouse endpoint. |
| 44 | List SQL Warehouses | databricks warehouses list | Lists all SQL warehouse endpoints. |
| 45 | Get SQL Warehouse Info | databricks warehouses get --id abc123456789 | Inspects status, size, and auto-stop minutes. |
| 46 | Set SQL Warehouse Auto Stop | databricks warehouses edit --id abc123456789 --auto-stop-mins 15 | Configures 15-minute auto-suspend timeout. |
| 47 | Create Delta Live Tables Pipeline | databricks pipelines create --json '{ "name": "dlt-etl", "clusters": [{ "num_workers": 2 }], "libraries": [{ "notebook": { "path": "/Workspace/Users/etl" } }], "target": "analytics" }' | Provisions declarative DLT pipeline. |
| 48 | Start DLT Pipeline | databricks pipelines start-update --pipeline-id 1234-abcd | Executes Delta Live Tables data pipeline. |
| 49 | Get DLT Pipeline Status | databricks pipelines get --pipeline-id 1234-abcd | Inspects state and health of DLT pipeline. |
| 50 | Stop DLT Pipeline | databricks pipelines stop --pipeline-id 1234-abcd | Stops running Delta Live Tables pipeline. |
| 51 | Delete DLT Pipeline | databricks pipelines delete --pipeline-id 1234-abcd | Deletes Delta Live Tables pipeline. |
| 52 | List DLT Pipelines | databricks pipelines list-pipelines | Lists all Delta Live Tables pipelines. |
| 53 | Create Managed Delta Table SQL | CREATE TABLE enterprise_catalog.analytics.orders (order_id INT, amount DECIMAL(10,2)) USING DELTA PARTITIONED BY (order_id); | Provisions partitioned Delta table. |
| 54 | Create Liquid Clustering Table | CREATE TABLE enterprise_catalog.analytics.events (id INT, dt DATE) USING DELTA CLUSTER BY (dt, id); | Provisions Delta table with Liquid Clustering. |
| 55 | Re-cluster Liquid Table | OPTIMIZE enterprise_catalog.analytics.events; | Triggers incremental liquid clustering compaction. |
| 56 | Check Delta Table Detail | DESCRIBE DETAIL enterprise_catalog.analytics.users; | Inspects file count, size, and format properties. |
| 57 | Check Delta Table History | DESCRIBE HISTORY enterprise_catalog.analytics.users; | Pulls commit history and operations log. |
| 58 | Restore Delta Table State | RESTORE TABLE enterprise_catalog.analytics.users TO VERSION AS OF 3; | Rolls back table state to version 3. |
| 59 | Convert Parquet to Delta | CONVERT TO DELTA parquet.`s3://my-bucket/data/` PARTITIONED BY (dt STRING); | In-place converts Parquet folder to Delta Lake. |
| 60 | Create Shallow Clone | CREATE TABLE enterprise_catalog.analytics.shallow_users SHALLOW CLONE enterprise_catalog.analytics.users; | Creates shallow reference table clone. |
| 61 | Create Deep Clone | CREATE TABLE enterprise_catalog.analytics.deep_users DEEP CLONE enterprise_catalog.analytics.users; | Creates full physical copy table clone. |
| 62 | Create Column Masking Function | CREATE FUNCTION email_mask(email STRING) RETURNS STRING RETURN CASE WHEN is_account_group_member('admin') THEN email ELSE '***@***.com' END; | Provisions column masking UDF. |
| 63 | Apply Column Masking Policy | ALTER TABLE enterprise_catalog.analytics.users ALTER COLUMN email SET MASK(email_mask); | Applies UDF masking to column. |
| 64 | Unset Column Masking Policy | ALTER TABLE enterprise_catalog.analytics.users ALTER COLUMN email UNSET MASK; | Removes column masking UDF. |
| 65 | Grant Schema All Privileges | GRANT ALL PRIVILEGES ON SCHEMA enterprise_catalog.analytics TO `data_engineers`; | Grants full schema control. |
| 66 | Revoke Privilege | REVOKE SELECT ON TABLE enterprise_catalog.analytics.users FROM `analysts`; | Revokes read access on table. |
| 67 | Show Grants on Table | SHOW GRANTS ON TABLE enterprise_catalog.analytics.users; | Lists permissions assigned on table. |
| 68 | Create Connection (Federation) | CREATE CONNECTION pg_conn TYPE POSTGRES OPTIONS (host '10.0.0.1', port '5432', user 'pguser', password 'pass'); | Provisions Foreign Data Wrapper connection. |
| 69 | Create Foreign Catalog | CREATE FOREIGN CATALOG pg_catalog USING CONNECTION pg_conn OPTIONS (database 'remote_db'); | Mounts remote database as foreign catalog. |
| 70 | Show Connections | SHOW CONNECTIONS; | Lists federated foreign data connections. |
| 71 | Drop Connection | DROP CONNECTION pg_conn; | Deletes foreign data connection. |
| 72 | Create Workspace Group | databricks groups create --display-name 'data-analysts' | Provisions security group in workspace. |
| 73 | Add Member to Group | databricks groups add-member --group-id 12345 --member-id 67890 | Adds user or principal to security group. |
| 74 | Remove Member from Group | databricks groups remove-member --group-id 12345 --member-id 67890 | Removes user from security group. |
| 75 | Delete Group | databricks groups delete --id 12345 | Deletes security group. |
| 76 | List Users in Workspace | databricks users list | Lists all users registered in workspace. |
| 77 | Create User in Workspace | databricks users create --user-name 'user@org.com' | Provisions user in workspace. |
| 78 | Delete User from Workspace | databricks users delete --id 12345 | Deletes user from workspace. |
| 79 | Create Instance Profile (AWS) | databricks instance-profiles add --instance-profile-arn arn:aws:iam::123:instance-profile/DatabricksRole | Registers EC2 instance profile IAM role. |
| 80 | List Instance Profiles | databricks instance-profiles list | Lists all registered AWS instance profiles. |
| 81 | Delete Instance Profile | databricks instance-profiles remove --instance-profile-arn arn:aws:iam::123:instance-profile/DatabricksRole | Removes AWS instance profile. |
| 82 | Create DBFS Directory | databricks fs mkdirs dbfs:/tmp/data/ | Provisions directory in DBFS filesystem. |
| 83 | Copy File to DBFS | databricks fs cp local.csv dbfs:/tmp/data/local.csv | Uploads local file to DBFS. |
| 84 | List DBFS Directory | databricks fs ls dbfs:/tmp/data/ | Lists files inside DBFS directory. |
| 85 | Remove DBFS File | databricks fs rm dbfs:/tmp/data/local.csv | Deletes file from DBFS. |
| 86 | Get Secret Scope List | databricks secrets list-scopes | Lists active Azure Key Vault / Databricks secret scopes. |
| 87 | Create Secret Scope | databricks secrets create-scope --scope app-keys | Provisions encrypted secret scope. |
| 88 | Put Secret Value | databricks secrets put-secret --scope app-keys --key db-pass --string-value 'Secret123!' | Stores encrypted secret key-value. |
| 89 | Get Secret Value in PySpark | dbutils.secrets.get(scope = 'app-keys', key = 'db-pass') | Retrieves secret in Python notebook without logging. |
| 90 | Delete Secret | databricks secrets delete-secret --scope app-keys --key db-pass | Deletes secret key. |
| 91 | Delete Secret Scope | databricks secrets delete-scope --scope app-keys | Deletes secret scope. |
| 92 | Create Workspace Directory | databricks workspace mkdirs /Workspace/Users/etl/ | Provisions workspace notebook folder. |
| 93 | Export Workspace Notebook | databricks workspace export /Workspace/Users/etl/job --format SOURCE --outfile job.py | Downloads notebook source code. |
| 94 | Import Workspace Notebook | databricks workspace import /Workspace/Users/etl/job --format SOURCE --language PYTHON --file job.py | Uploads python file as notebook. |
| 95 | Delete Workspace Directory | databricks workspace delete /Workspace/Users/etl/ --recursive | Deletes workspace directory and content. |
| 96 | List Workspace Contents | databricks workspace list /Workspace/Users/ | Lists files and notebooks in workspace folder. |
| 97 | Check Unity Catalog Storage Usage | SELECT table_name, num_files, size_in_bytes FROM system.information_schema.tables WHERE table_schema='analytics'; | Inspects physical storage bytes. |
| 98 | Check Query History System Table | SELECT query_text, execution_status, total_duration_ms FROM system.query.history ORDER BY start_time DESC LIMIT 10; | Queries system table for analytical query performance. |
| 99 | Check Lineage System Table | SELECT * FROM system.access.table_lineage; | Queries system table for automated data lineage graph. |
| 100 | Check Databricks Runtime Version | SELECT spark_version(); | Outputs running Databricks Apache Spark build version. |
| 101 | Check Metastore Name | databricks metastores get --id prod-metastore --query "name" | Outputs metastore name. |
| 102 | Check Metastore Region | databricks metastores get --id prod-metastore --query "region" | Outputs metastore cloud region. |
| 103 | Check Metastore Storage Root | databricks metastores get --id prod-metastore --query "storage_root" | Outputs metastore S3/ADLS root path. |
| 104 | Check Catalog Type | DESCRIBE CATALOG enterprise_catalog; | Inspects catalog type (MANAGED vs FOREIGN). |
| 105 | Check Schema Location | DESCRIBE SCHEMA enterprise_catalog.analytics; | Inspects S3/ADLS location of schema. |
| 106 | Check Table Format | DESCRIBE DETAIL enterprise_catalog.analytics.users; | Verifies table format is DELTA. |
| 107 | Check Table Partition Columns | DESCRIBE DETAIL enterprise_catalog.analytics.users; | Lists partition columns. |
| 108 | Check Volume Type | DESCRIBE VOLUME enterprise_catalog.analytics.raw_files; | Inspects volume type (MANAGED vs EXTERNAL). |
| 109 | Check Volume Path | DESCRIBE VOLUME enterprise_catalog.analytics.raw_files; | Inspects S3/ADLS path of volume. |
| 110 | Check Storage Credential IAM Role | databricks storage-credentials get --name s3-cred --query "aws_iam_role.role_arn" | Outputs IAM role ARN. |
| 111 | Check External Location URL | databricks external-locations get --name s3-loc --query "url" | Outputs external location S3 URL. |
| 112 | Check External Location Credential Name | databricks external-locations get --name s3-loc --query "credential_name" | Outputs credential name. |
| 113 | Check Service Principal Application ID | databricks service-principals get --id 12345-abc --query "application_id" | Outputs application ID. |
| 114 | Check Cluster Name | databricks clusters get --cluster-id 1234-5678 --query "cluster_name" | Outputs cluster name. |
| 115 | Check Cluster State | databricks clusters get --cluster-id 1234-5678 --query "state" | Outputs cluster state (RUNNING, TERMINATED). |
| 116 | Check Cluster DBR Version | databricks clusters get --cluster-id 1234-5678 --query "spark_version" | Outputs DBR runtime version. |
| 117 | Check Cluster Node Type | databricks clusters get --cluster-id 1234-5678 --query "node_type_id" | Outputs VM node type. |
| 118 | Check Cluster Worker Count | databricks clusters get --cluster-id 1234-5678 --query "num_workers" | Outputs worker VM count. |
| 119 | Check SQL Warehouse Size | databricks warehouses get --id abc123456789 --query "cluster_size" | Outputs warehouse size (X-Small, Small, Medium). |
| 120 | Check SQL Warehouse State | databricks warehouses get --id abc123456789 --query "state" | Outputs warehouse state (RUNNING, STOPPED). |
| 121 | Check SQL Warehouse Auto Stop Minutes | databricks warehouses get --id abc123456789 --query "auto_stop_mins" | Outputs auto-stop timeout in minutes. |
| 122 | Check DLT Pipeline Name | databricks pipelines get --pipeline-id 1234-abcd --query "name" | Outputs pipeline name. |
| 123 | Check DLT Pipeline State | databricks pipelines get --pipeline-id 1234-abcd --query "state" | Outputs pipeline state (IDLE, RUNNING). |
| 124 | Check Job Name | databricks jobs get --job-id 9876 --query "settings.name" | Outputs job name. |
| 125 | Check Job Created Time | databricks jobs get --job-id 9876 --query "created_time" | Outputs job creation timestamp. |
| 126 | Check Workspace User Name | databricks current-user me --query "user_name" | Outputs authenticated user name. |
| 127 | Check Workspace Host URL | databricks config get --query "host" | Outputs workspace host URL. |
| 128 | Check Spark Version SQL | SELECT spark_version(); | Outputs Spark build version. |
| 129 | Check Ping Query SQL | SELECT 1; | Simple connection ping test returning 1. |
| 130 | Check Current User SQL | SELECT current_user(); | Outputs current user in session. |
| 131 | Check Workspace Groups List | databricks groups list | Lists all workspace user groups. |
| 132 | Check Workspace Service Principals List | databricks service-principals list | Lists all workspace service principals. |
| 133 | Check Workspace Instance Profiles List | databricks instance-profiles list | Lists all registered AWS instance profiles. |
| 134 | Check Workspace Secrets Scope List | databricks secrets list-scopes | Lists all secret scopes. |
| 135 | Check Workspace Catalogs List SQL | SHOW CATALOGS; | Lists all accessible Unity catalogs. |
| 136 | Configure CLI Profile (Alt 135) | databricks configure --token | Authenticates Databricks CLI session. |
| 137 | Create Metastore (Alt 136) | databricks metastores create --name prod-metastore --storage-root s3://my-bucket/unity | Provisions Unity Catalog metastore. |
| 138 | Create Catalog (Alt 137) | CREATE CATALOG IF NOT EXISTS enterprise_catalog; | Provisions top-level data catalog. |
| 139 | Drop Catalog (Alt 138) | DROP CATALOG IF EXISTS enterprise_catalog CASCADE; | Deletes catalog and schemas. |
| 140 | Create Schema (Database) (Alt 139) | CREATE SCHEMA IF NOT EXISTS enterprise_catalog.analytics; | Provisions database schema namespace. |
| 141 | Create Managed Table (Delta) (Alt 140) | CREATE TABLE enterprise_catalog.analytics.users (id INT, name STRING) USING DELTA; | Provisions Delta Lake table. |
| 142 | Create External Table (Alt 141) | CREATE TABLE enterprise_catalog.analytics.ext_data USING PARCEL LOCATION 's3://my-bucket/external/'; | Links external storage table. |
| 143 | Optimize Delta Table (Alt 142) | OPTIMIZE enterprise_catalog.analytics.users ZORDER BY (id); | Compacts small files and applies Z-Order. |
| 144 | Vacuum Delta History (Alt 143) | VACUUM enterprise_catalog.analytics.users RETAIN 168 HOURS; | Purges expired historical file versions. |
| 145 | Describe Table History (Alt 144) | DESCRIBE HISTORY enterprise_catalog.analytics.users; | Inspects transactional audit timeline. |
| 146 | Time Travel Query (Alt 145) | SELECT * FROM enterprise_catalog.analytics.users VERSION AS OF 5; | Queries historical snapshot state. |
| 147 | Grant Catalog Privilege (Alt 146) | GRANT USE CATALOG ON CATALOG enterprise_catalog TO `data_engineers`; | Assigns catalog access rights. |
| 148 | Grant Schema Privilege (Alt 147) | GRANT USAGE, SELECT ON SCHEMA enterprise_catalog.analytics TO `analysts`; | Assigns schema access rights. |
| 149 | Create Volume (Storage) (Alt 148) | CREATE VOLUME enterprise_catalog.analytics.raw_files; | Provisions non-tabular file volume. |
| 150 | List Volume Files (Alt 149) | LIST '/Volumes/enterprise_catalog/analytics/raw_files/'; | Inspects files inside Unity volume. |
| 151 | Create Credential (Alt 150) | databricks storage-credentials create --name s3-cred --aws-iam-role arn:aws:iam::123:role/DatabricksRole | Provisions secure cloud storage credential. |
| 152 | Create External Location (Alt 151) | databricks external-locations create --name s3-loc --url s3://my-bucket/ --credential-name s3-cred | Provisions secure external storage path. |
| 153 | Create Service Principal (Alt 152) | databricks service-principals create --application-id 12345-abc | Provisions automated workload identity. |
| 154 | Grant Service Principal Role (Alt 153) | databricks workspace-bindings update-workspace-bindings --catalog-name enterprise_catalog | Binds catalog to secure workspace. |
| 155 | Create Cluster Job (Alt 154) | databricks jobs create --json '{ "name": "ETL Job", "existing_cluster_id": "1234-5678" }' | Provisions automated Spark pipeline job. |
| 156 | Run Job (Alt 155) | databricks jobs run-now --job-id 9876 | Manually triggers Spark pipeline execution. |
| 157 | Get Job Run Status (Alt 156) | databricks runs get --run-id 4567 | Inspects active Spark job progress. |
| 158 | Create Feature Store Table (Alt 157) | CREATE TABLE enterprise_catalog.analytics.features USING DELTA; | Provisions ML feature engineering store. |
| 159 | Register MLflow Model (Alt 158) | databricks mlflow models create --name enterprise_model | Publishes machine learning model asset. |
| 160 | Create Share (Delta Sharing) (Alt 159) | CREATE SHARE sales_share; ALTER SHARE sales_share ADD TABLE enterprise_catalog.analytics.users; | Provisions secure external data share. |
| 161 | Create Recipient (Delta Sharing) (Alt 160) | CREATE RECIPIENT partner_org AS SHARE sales_share; | Grants external partner data access. |
| 162 | Check Unity Audit Logs (Alt 161) | SELECT * FROM system.access.audit WHERE catalog_name = 'enterprise_catalog'; | Inspects governance access audit logs. |
| 163 | Create Row Filter Function (Alt 162) | CREATE FUNCTION dept_filter(dept STRING) RETURNS BOOLEAN RETURN dept = current_user(); | Provisions row-level security function. |
| 164 | Apply Row Filter (Alt 163) | ALTER TABLE enterprise_catalog.analytics.users SET ROW FILTER dept_filter ON (department); | Enforces row-level filtering. |
| 165 | Check Cluster Compute Nodes (Alt 164) | databricks clusters list | Inspects active Apache Spark compute clusters. |
| 166 | Create Interactive Cluster (Alt 165) | databricks clusters create --json '{ "cluster_name": "dev-cluster", "spark_version": "13.3.x-scala2.12", "node_type_id": "i3.xlarge", "num_workers": 2 }' | Provisions interactive Spark cluster. |
| 167 | Start Compute Cluster (Alt 166) | databricks clusters start --cluster-id 1234-5678 | Boots stopped Spark compute cluster. |
| 168 | Restart Compute Cluster (Alt 167) | databricks clusters restart --cluster-id 1234-5678 | Restarts active Spark cluster. |
| 169 | Terminate Compute Cluster (Alt 168) | databricks clusters delete --cluster-id 1234-5678 | Halts compute cluster to stop billing. |
| 170 | Permanent Delete Cluster (Alt 169) | databricks clusters permanent-delete --cluster-id 1234-5678 | Deletes cluster definition completely. |
| 171 | Get Cluster Information (Alt 170) | databricks clusters get --cluster-id 1234-5678 | Inspects cluster state, workers, and driver IP. |
| 172 | List Cluster Node Types (Alt 171) | databricks clusters list-node-types | Lists available VM node sizes across cloud. |
| 173 | List Spark Runtimes (Alt 172) | databricks clusters spark-versions | Lists supported Databricks Runtime (DBR) versions. |
| 174 | Create Single Node Cluster (Alt 173) | databricks clusters create --json '{ "cluster_name": "single-node", "spark_version": "13.3.x-scala2.12", "node_type_id": "i3.xlarge", "spark_conf": { "spark.databricks.cluster.profile": "singleNode", "spark.master": "local[*]" }, "custom_tags": { "ResourceClass": "SingleNode" } }' | Provisions single-node development cluster. |
| 175 | Create SQL Warehouse (Alt 174) | databricks warehouses create --name prod-sql-wh --cluster-size X-Small --max-num-clusters 2 | Provisions serverless SQL warehouse endpoint. |
| 176 | Start SQL Warehouse (Alt 175) | databricks warehouses start --id abc123456789 | Boots serverless SQL warehouse. |
| 177 | Stop SQL Warehouse (Alt 176) | databricks warehouses stop --id abc123456789 | Halts serverless SQL warehouse. |
| 178 | Delete SQL Warehouse (Alt 177) | databricks warehouses delete --id abc123456789 | Deletes SQL warehouse endpoint. |
| 179 | List SQL Warehouses (Alt 178) | databricks warehouses list | Lists all SQL warehouse endpoints. |
| 180 | Get SQL Warehouse Info (Alt 179) | databricks warehouses get --id abc123456789 | Inspects status, size, and auto-stop minutes. |
| 181 | Set SQL Warehouse Auto Stop (Alt 180) | databricks warehouses edit --id abc123456789 --auto-stop-mins 15 | Configures 15-minute auto-suspend timeout. |
| 182 | Create Delta Live Tables Pipeline (Alt 181) | databricks pipelines create --json '{ "name": "dlt-etl", "clusters": [{ "num_workers": 2 }], "libraries": [{ "notebook": { "path": "/Workspace/Users/etl" } }], "target": "analytics" }' | Provisions declarative DLT pipeline. |
| 183 | Start DLT Pipeline (Alt 182) | databricks pipelines start-update --pipeline-id 1234-abcd | Executes Delta Live Tables data pipeline. |
| 184 | Get DLT Pipeline Status (Alt 183) | databricks pipelines get --pipeline-id 1234-abcd | Inspects state and health of DLT pipeline. |
| 185 | Stop DLT Pipeline (Alt 184) | databricks pipelines stop --pipeline-id 1234-abcd | Stops running Delta Live Tables pipeline. |
| 186 | Delete DLT Pipeline (Alt 185) | databricks pipelines delete --pipeline-id 1234-abcd | Deletes Delta Live Tables pipeline. |
| 187 | List DLT Pipelines (Alt 186) | databricks pipelines list-pipelines | Lists all Delta Live Tables pipelines. |
| 188 | Create Managed Delta Table SQL (Alt 187) | CREATE TABLE enterprise_catalog.analytics.orders (order_id INT, amount DECIMAL(10,2)) USING DELTA PARTITIONED BY (order_id); | Provisions partitioned Delta table. |
| 189 | Create Liquid Clustering Table (Alt 188) | CREATE TABLE enterprise_catalog.analytics.events (id INT, dt DATE) USING DELTA CLUSTER BY (dt, id); | Provisions Delta table with Liquid Clustering. |
| 190 | Re-cluster Liquid Table (Alt 189) | OPTIMIZE enterprise_catalog.analytics.events; | Triggers incremental liquid clustering compaction. |
| 191 | Check Delta Table Detail (Alt 190) | DESCRIBE DETAIL enterprise_catalog.analytics.users; | Inspects file count, size, and format properties. |
| 192 | Check Delta Table History (Alt 191) | DESCRIBE HISTORY enterprise_catalog.analytics.users; | Pulls commit history and operations log. |
| 193 | Restore Delta Table State (Alt 192) | RESTORE TABLE enterprise_catalog.analytics.users TO VERSION AS OF 3; | Rolls back table state to version 3. |
| 194 | Convert Parquet to Delta (Alt 193) | CONVERT TO DELTA parquet.`s3://my-bucket/data/` PARTITIONED BY (dt STRING); | In-place converts Parquet folder to Delta Lake. |
| 195 | Create Shallow Clone (Alt 194) | CREATE TABLE enterprise_catalog.analytics.shallow_users SHALLOW CLONE enterprise_catalog.analytics.users; | Creates shallow reference table clone. |
| 196 | Create Deep Clone (Alt 195) | CREATE TABLE enterprise_catalog.analytics.deep_users DEEP CLONE enterprise_catalog.analytics.users; | Creates full physical copy table clone. |
| 197 | Create Column Masking Function (Alt 196) | CREATE FUNCTION email_mask(email STRING) RETURNS STRING RETURN CASE WHEN is_account_group_member('admin') THEN email ELSE '***@***.com' END; | Provisions column masking UDF. |
| 198 | Apply Column Masking Policy (Alt 197) | ALTER TABLE enterprise_catalog.analytics.users ALTER COLUMN email SET MASK(email_mask); | Applies UDF masking to column. |
| 199 | Unset Column Masking Policy (Alt 198) | ALTER TABLE enterprise_catalog.analytics.users ALTER COLUMN email UNSET MASK; | Removes column masking UDF. |
| 200 | Grant Schema All Privileges (Alt 199) | GRANT ALL PRIVILEGES ON SCHEMA enterprise_catalog.analytics TO `data_engineers`; | Grants full schema control. |
Apache Druid OLAP
Technical Architecture & Overview
Apache Druid is a real-time, high-performance columnar analytical database designed for sub-second queries on event-driven time-series data. It uses a distributed architecture dividing responsibilities among Coordinator, Overlord, Broker, Historical, MiddleManager (Peons), and Router nodes, storing data in immutable time-partitioned segments.
Primary Use Cases: Real-time streaming analytics, clickstream/user event tracking, network telemetry monitoring, application performance monitoring (APM), and interactive OLAP dashboards.
Core Components: Coordinator (Segment Manager), Overlord (Ingestion Task Master), Broker (Query Routing), Historical (Columnar Segment Storage), MiddleManager/Peon (Real-time Ingestion), and Deep Storage (S3/HDFS/GCS).
Exhaustive 200-command administrative, diagnostic, and operational matrix for Apache Druid.
| # | Operation / Action | Druid API / SQL Syntax | Description |
|---|---|---|---|
| 1 | Check Cluster Health | curl http://localhost:8081/status/health | Verifies coordinator node health. |
| 2 | List Supervisors | curl http://localhost:8081/druid/indexer/v1/supervisor | Inspects real-time streaming ingestion tasks. |
| 3 | Submit Supervisor Spec | curl -X POST -H 'Content-Type: application/json' -d @spec.json http://localhost:8081/druid/indexer/v1/supervisor | Provisions Kafka indexing supervisor. |
| 4 | Terminate Supervisor | curl -X POST http://localhost:8081/druid/indexer/v1/supervisor/my-datasource/terminate | Stops streaming ingestion supervisor. |
| 5 | List Active Tasks | curl http://localhost:8081/druid/indexer/v1/tasks | Inspects background indexing tasks. |
| 6 | Kill Task | curl -X POST http://localhost:8081/druid/indexer/v1/task/{taskId}/shutdown | Terminates background indexing task. |
| 7 | Get Cluster Load Status | curl http://localhost:8081/druid/coordinator/v1/loadstatus | Evaluates segment loading progress. |
| 8 | Get Segments Metadata | curl http://localhost:8081/druid/coordinator/v1/metadata/datasources/telemetry/segments | Inspects time-series data segments. |
| 9 | Disable Datasource Segments | curl -X DELETE http://localhost:8081/druid/coordinator/v1/datasources/telemetry | Soft-deletes datasource segments. |
| 10 | Execute SQL Query | curl -X POST -H 'Content-Type: application/json' -d '{"query":"SELECT COUNT(*) FROM telemetry"}' http://localhost:8088/druid/v2/sql | Executes high-speed analytical query. |
| 11 | Get Coordinator Servers | curl http://localhost:8081/druid/coordinator/v1/servers | Inspects historical and middlemanager nodes. |
| 12 | Set Retention Rules | curl -X POST -H 'Content-Type: application/json' -d '[{"type":"period","period":"P90D","action":"drop"}]' http://localhost:8081/druid/coordinator/v1/rules/telemetry | Configures automated data lifecycle retention. |
| 13 | Get Retention Rules | curl http://localhost:8081/druid/coordinator/v1/rules/telemetry | Inspects active data retention rules. |
| 14 | Get Compaction Status | curl http://localhost:8081/druid/coordinator/v1/compaction/status | Evaluates historical segment compaction. |
| 15 | Submit Compaction Config | curl -X POST -H 'Content-Type: application/json' -d '{"dataSource":"telemetry"}' http://localhost:8081/druid/coordinator/v1/compaction/configurations | Configures background segment compaction. |
| 16 | Get Overlord Leader | curl http://localhost:8090/druid/indexer/v1/leader | Inspects Overlord master leader node. |
| 17 | Get MiddleManager Slots | curl http://localhost:8090/druid/indexer/v1/workers | Inspects indexing worker task slots. |
| 18 | Submit Batch Ingestion | curl -X POST -H 'Content-Type: application/json' -d @batch-spec.json http://localhost:8081/druid/indexer/v1/task | Provisions batch indexing task. |
| 19 | Get Query Metrics | curl http://localhost:8088/druid/v2/metrics | Pulls broker query latency telemetry. |
| 20 | Get Datasource List | curl http://localhost:8081/druid/coordinator/v1/datasources | Lists all active analytical datasources. |
| 21 | Kill Datasource Permanently | curl -X DELETE http://localhost:8081/druid/coordinator/v1/datasources/telemetry?intervals=1000/3000 | Purges historical segment files. |
| 22 | Get Broker Status | curl http://localhost:8082/status | Inspects query broker service state. |
| 23 | Get Historical Status | curl http://localhost:8083/status | Inspects storage historical node state. |
| 24 | Get Indexing Service Config | curl http://localhost:8081/druid/coordinator/v1/config | Inspects cluster coordinator parameters. |
| 25 | Update Dynamic Config | curl -X POST -H 'Content-Type: application/json' -d '{"maxSegmentsToMove":10}' http://localhost:8081/druid/coordinator/v1/config | Modifies dynamic cluster parameters. |
| 26 | Get Lookups State | curl http://localhost:8081/druid/coordinator/v1/lookups/config | Inspects in-memory dimension lookups. |
| 27 | Update Lookup Config | curl -X POST -H 'Content-Type: application/json' -d @lookup.json http://localhost:8081/druid/coordinator/v1/lookups/config/tier1 | Provisions dimension lookup table. |
| 28 | Get Task Reports | curl http://localhost:8081/druid/indexer/v1/task/{taskId}/reports | Inspects indexing task execution report. |
| 29 | Get Metastore Metadata Store State | curl http://localhost:8081/druid/coordinator/v1/metadata/storagestats | Inspects metadata database storage. |
| 30 | Restart Druid Service | sudo systemctl restart druid-coordinator | Restarts coordinator daemon. |
| 31 | Suspend Supervisor | curl -X POST http://localhost:8081/druid/indexer/v1/supervisor/my-datasource/suspend | Pauses real-time ingestion supervisor. |
| 32 | Resume Supervisor | curl -X POST http://localhost:8081/druid/indexer/v1/supervisor/my-datasource/resume | Resumes real-time ingestion supervisor. |
| 33 | Reset Supervisor | curl -X POST http://localhost:8081/druid/indexer/v1/supervisor/my-datasource/reset | Resets offsets for streaming supervisor. |
| 34 | Get Supervisor Stats | curl http://localhost:8081/druid/indexer/v1/supervisor/my-datasource/stats | Pulls real-time processing statistics. |
| 35 | Get Supervisor Status | curl http://localhost:8081/druid/indexer/v1/supervisor/my-datasource/status | Inspects active lag and task health. |
| 36 | Get All Supervisors Status | curl http://localhost:8081/druid/indexer/v1/supervisor?full | Pulls detailed status for all supervisors. |
| 37 | Get Task Status | curl http://localhost:8081/druid/indexer/v1/task/{taskId}/status | Inspects state of specific indexing task. |
| 38 | Get Task Log | curl http://localhost:8081/druid/indexer/v1/task/{taskId}/log | Downloads stdout log of indexing task. |
| 39 | Get Running Tasks | curl http://localhost:8081/druid/indexer/v1/runningTasks | Lists all active tasks across MiddleManagers. |
| 40 | Get Pending Tasks | curl http://localhost:8081/druid/indexer/v1/pendingTasks | Lists tasks queued for execution. |
| 41 | Get Waiting Tasks | curl http://localhost:8081/druid/indexer/v1/waitingTasks | Lists tasks waiting for lock acquisition. |
| 42 | Get Complete Tasks | curl http://localhost:8081/druid/indexer/v1/completeTasks | Lists finished indexing tasks. |
| 43 | Get Coordinator Dynamic Config | curl http://localhost:8081/druid/coordinator/v1/config | Inspects segment balancing parameters. |
| 44 | Get Historical Tier Segments | curl http://localhost:8081/druid/coordinator/v1/tiers | Lists historical tier segment distribution. |
| 45 | Get Tier Load Status | curl http://localhost:8081/druid/coordinator/v1/loadqueue | Inspects segment download queue per node. |
| 46 | Get Datasource Segment Intervals | curl http://localhost:8081/druid/coordinator/v1/datasources/telemetry/intervals | Lists active time intervals in datasource. |
| 47 | Get Datasource Segment Details | curl http://localhost:8081/druid/coordinator/v1/datasources/telemetry/intervals/2026-07-01_2026-08-01 | Inspects segments in specific interval. |
| 48 | Enable Datasource Segment | curl -X POST http://localhost:8081/druid/coordinator/v1/datasources/telemetry/segments/{segmentId} | Re-enables soft-deleted segment. |
| 49 | Mark Segment Unused | curl -X DELETE http://localhost:8081/druid/coordinator/v1/datasources/telemetry/segments/{segmentId} | Soft-deletes specific segment ID. |
| 50 | Get Unused Segments | curl http://localhost:8081/druid/coordinator/v1/indexing/test/head | Inspects metadata for unused segments. |
| 51 | Submit Kill Task | curl -X POST -H 'Content-Type: application/json' -d '{"type":"kill","dataSource":"telemetry","interval":"2026-01-01/2026-02-01"}' http://localhost:8081/druid/indexer/v1/task | Permanently purges unused segments from deep storage. |
| 52 | Get Cluster Server Information | curl http://localhost:8081/druid/coordinator/v1/servers?full | Inspects disk usage and tiers per server. |
| 53 | Get Server Segment List | curl http://localhost:8081/druid/coordinator/v1/servers/{serverName}/segments | Lists all segments hosted on specific Historical node. |
| 54 | Get Router Health | curl http://localhost:8888/status/health | Verifies Router query gateway health. |
| 55 | Get Broker Cluster Nodes | curl http://localhost:8082/druid/v2/datasources | Lists datasources available via Broker. |
| 56 | Execute Native JSON Query | curl -X POST -H 'Content-Type: application/json' -d @query.json http://localhost:8082/druid/v2 | Executes low-level JSON aggregation query. |
| 57 | Cancel Broker SQL Query | curl -X DELETE http://localhost:8082/druid/v2/sql/{queryId} | Cancels active SQL query on Broker. |
| 58 | Get Broker SQL Explain | curl -X POST -H 'Content-Type: application/json' -d '{"query":"EXPLAIN PLAN FOR SELECT COUNT(*) FROM telemetry"}' http://localhost:8082/druid/v2/sql | Explains SQL execution plan. |
| 59 | Get MiddleManager Workers List | curl http://localhost:8090/druid/indexer/v1/workers | Lists MiddleManager instances and capacities. |
| 60 | Disable MiddleManager Worker | curl -X POST http://localhost:8090/druid/indexer/v1/worker/{workerHost}/disable | Disables new task assignment to worker. |
| 61 | Enable MiddleManager Worker | curl -X POST http://localhost:8090/druid/indexer/v1/worker/{workerHost}/enable | Re-enables task assignment to worker. |
| 62 | Get Overlord Audit Logs | curl http://localhost:8090/druid/indexer/v1/audit/log | Inspects task submission audit history. |
| 63 | Get Lookup Tier Nodes | curl http://localhost:8081/druid/coordinator/v1/lookups/config/tiers | Lists lookup configuration tiers. |
| 64 | Delete Lookup Config | curl -X DELETE http://localhost:8081/druid/coordinator/v1/lookups/config/tier1/my_lookup | Deletes dimension lookup table. |
| 65 | Get Rule History | curl http://localhost:8081/druid/coordinator/v1/rules/history?count=10 | Inspects historical retention rule changes. |
| 66 | Get Dynamic Config History | curl http://localhost:8081/druid/coordinator/v1/config/history?count=10 | Inspects historical coordinator config changes. |
| 67 | Get Compaction Task Config | curl http://localhost:8081/druid/coordinator/v1/compaction/config/telemetry | Inspects compaction settings for datasource. |
| 68 | Delete Compaction Config | curl -X DELETE http://localhost:8081/druid/coordinator/v1/compaction/config/telemetry | Deletes automated compaction configuration. |
| 69 | Get Indexing Service Scaling Stats | curl http://localhost:8090/druid/indexer/v1/autoscale | Inspects MiddleManager auto-scaling state. |
| 70 | Get Deep Storage Location | curl http://localhost:8081/druid/coordinator/v1/metadata/datasources | Inspects S3/HDFS deep storage paths. |
| 71 | Query Druid Information Schema Tables | SELECT * FROM INFORMATION_SCHEMA.TABLES WHERE TABLE_SCHEMA='druid'; | Queries SQL metadata schema for tables. |
| 72 | Query Druid Information Schema Columns | SELECT * FROM INFORMATION_SCHEMA.COLUMNS WHERE TABLE_NAME='telemetry'; | Queries SQL metadata schema for columns. |
| 73 | Query Druid Information Schema Segments | SELECT * FROM sys.segments WHERE datasource='telemetry'; | Queries system table for segment details. |
| 74 | Query Druid Information Schema Servers | SELECT * FROM sys.servers; | Queries system table for active nodes. |
| 75 | Query Druid Information Schema Tasks | SELECT * FROM sys.tasks WHERE status='RUNNING'; | Queries system table for active tasks. |
| 76 | Check Druid Version | curl http://localhost:8081/status | Outputs Druid release version string. |
| 77 | Check MiddleManager Health | curl http://localhost:8091/status/health | Verifies MiddleManager process health. |
| 78 | Check Historical Node Health | curl http://localhost:8083/status/health | Verifies Historical storage node health. |
| 79 | Check Overlord Health | curl http://localhost:8090/status/health | Verifies Overlord task master health. |
| 80 | Restart Historical Daemon | sudo systemctl restart druid-historical | Restarts Historical node service. |
| 81 | Restart MiddleManager Daemon | sudo systemctl restart druid-middlemanager | Restarts MiddleManager node service. |
| 82 | Restart Broker Daemon | sudo systemctl restart druid-broker | Restarts Broker service. |
| 83 | Restart Router Daemon | sudo systemctl restart druid-router | Restarts Router gateway service. |
| 84 | Restart Overlord Daemon | sudo systemctl restart druid-overlord | Restarts Overlord task master service. |
| 85 | Flush Segment Cache | POST http://localhost:8083/druid/historical/v1/cache/flush | Flushes Historical node segment cache. |
| 86 | Set Max Query Timeout Session | curl -X POST -H 'Content-Type: application/json' -d '{"query":"SELECT COUNT(*) FROM telemetry","context":{"timeout":30000}}' http://localhost:8088/druid/v2/sql | Caps query execution to 30 seconds. |
| 87 | Set Query Timezone Session | curl -X POST -H 'Content-Type: application/json' -d '{"query":"SELECT COUNT(*) FROM telemetry","context":{"sqlTimeZone":"UTC"}}' http://localhost:8088/druid/v2/sql | Sets SQL session timezone to UTC. |
| 88 | Set Vector Execution Strategy | curl -X POST -H 'Content-Type: application/json' -d '{"query":"SELECT COUNT(*) FROM telemetry","context":{"vectorize":"true"}}' http://localhost:8088/druid/v2/sql | Enforces vectorized query execution engine. |
| 89 | Check Task Slot Utilization | SELECT sum(worker_slots) FROM sys.workers; | Calculates total indexing slots across cluster. |
| 90 | Check Segment Size Distribution | SELECT datasource, AVG(size) FROM sys.segments GROUP BY datasource; | Calculates average segment file size in bytes. |
| 91 | Check Deep Storage Sync Status | curl http://localhost:8081/druid/coordinator/v1/metadata/status | Verifies metadata database sync with deep storage. |
| 92 | Purge All Audit History | POST http://localhost:8081/druid/coordinator/v1/history/purge | Clears administrative audit log history. |
| 93 | Set Router Balancing Strategy | curl -X POST -H 'Content-Type: application/json' -d '{"strategy":"connectionCount"}' http://localhost:8888/druid/router/v1/config | Updates Router broker balancing strategy. |
| 94 | Check JVM Memory Usage | curl http://localhost:8081/status/properties | Inspects JVM system properties and memory limits. |
| 95 | Verify Druid API Version | curl http://localhost:8081/status/version | Outputs API version string. |
| 96 | Check Coordinator Thread Pool | curl http://localhost:8081/druid/coordinator/v1/metrics | Inspects coordinator thread pool latency. |
| 97 | Check Indexing Task Queue Size | curl http://localhost:8090/druid/indexer/v1/queue/status | Inspects pending task queue count. |
| 98 | Force Segment Load | POST http://localhost:8081/druid/coordinator/v1/rules/loadNow | Forces immediate loading of offline segments. |
| 99 | Force Segment Unload | POST http://localhost:8081/druid/coordinator/v1/rules/dropNow | Forces immediate unloading of active segments. |
| 100 | Check Cluster Status Summary | curl http://localhost:8081/druid/coordinator/v1/cluster/status | Outputs high-level cluster health summary. |
| 101 | Check Coordinator Health HTTP | curl http://localhost:8081/status/health | Queries Coordinator health status. |
| 102 | Check Overlord Health HTTP | curl http://localhost:8090/status/health | Queries Overlord health status. |
| 103 | Check Broker Health HTTP | curl http://localhost:8082/status/health | Queries Broker health status. |
| 104 | Check Historical Health HTTP | curl http://localhost:8083/status/health | Queries Historical health status. |
| 105 | Check Router Health HTTP | curl http://localhost:8888/status/health | Queries Router health status. |
| 106 | Check MiddleManager Health HTTP | curl http://localhost:8091/status/health | Queries MiddleManager health status. |
| 107 | Check Coordinator Status HTTP | curl http://localhost:8081/status | Outputs Coordinator process info and uptime. |
| 108 | Check Overlord Status HTTP | curl http://localhost:8090/status | Outputs Overlord process info and uptime. |
| 109 | Check Broker Status HTTP | curl http://localhost:8082/status | Outputs Broker process info and uptime. |
| 110 | Check Historical Status HTTP | curl http://localhost:8083/status | Outputs Historical process info and uptime. |
| 111 | Check Router Status HTTP | curl http://localhost:8888/status | Outputs Router process info and uptime. |
| 112 | Check MiddleManager Status HTTP | curl http://localhost:8091/status | Outputs MiddleManager process info and uptime. |
| 113 | Check Coordinator Version | curl http://localhost:8081/status/version | Outputs Coordinator release version string. |
| 114 | Check Overlord Version | curl http://localhost:8090/status/version | Outputs Overlord release version string. |
| 115 | Check Broker Version | curl http://localhost:8082/status/version | Outputs Broker release version string. |
| 116 | Check Historical Version | curl http://localhost:8083/status/version | Outputs Historical release version string. |
| 117 | Check Router Version | curl http://localhost:8888/status/version | Outputs Router release version string. |
| 118 | Check MiddleManager Version | curl http://localhost:8091/status/version | Outputs MiddleManager release version string. |
| 119 | Check Active Supervisors Count | curl -s http://localhost:8081/druid/indexer/v1/supervisor | grep -o '"' | wc -l | Counts active streaming supervisors. |
| 120 | Check Active Tasks Count | curl -s http://localhost:8081/druid/indexer/v1/tasks | grep -o '"id"' | wc -l | Counts active indexing tasks. |
| 121 | Check Active Datasources Count | curl -s http://localhost:8081/druid/coordinator/v1/datasources | grep -o '"' | wc -l | Counts active datasources. |
| 122 | Check Active Historical Servers Count | curl -s http://localhost:8081/druid/coordinator/v1/servers | grep -o '"' | wc -l | Counts connected Historical servers. |
| 123 | Check SQL Query Ping | curl -X POST -H 'Content-Type: application/json' -d '{"query":"SELECT 1"}' http://localhost:8088/druid/v2/sql | Executes simple SQL ping test. |
| 124 | Check SQL Query Timezone | curl -X POST -H 'Content-Type: application/json' -d '{"query":"SELECT CURRENT_TIMESTAMP"}' http://localhost:8088/druid/v2/sql | Queries active server timestamp. |
| 125 | Check SQL Query Version | curl -X POST -H 'Content-Type: application/json' -d '{"query":"SELECT CURRENT_USER"}' http://localhost:8088/druid/v2/sql | Queries current execution user. |
| 126 | Check System Tasks Count SQL | curl -X POST -H 'Content-Type: application/json' -d '{"query":"SELECT count(*) FROM sys.tasks"}' http://localhost:8088/druid/v2/sql | Counts total tasks via SQL sys schema. |
| 127 | Check System Segments Count SQL | curl -X POST -H 'Content-Type: application/json' -d '{"query":"SELECT count(*) FROM sys.segments"}' http://localhost:8088/druid/v2/sql | Counts total segments via SQL sys schema. |
| 128 | Check System Servers Count SQL | curl -X POST -H 'Content-Type: application/json' -d '{"query":"SELECT count(*) FROM sys.servers"}' http://localhost:8088/druid/v2/sql | Counts total servers via SQL sys schema. |
| 129 | Check System Server Segments Count SQL | curl -X POST -H 'Content-Type: application/json' -d '{"query":"SELECT count(*) FROM sys.server_segments"}' http://localhost:8088/druid/v2/sql | Counts total server segment mappings. |
| 130 | Check System Supervisors Count SQL | curl -X POST -H 'Content-Type: application/json' -d '{"query":"SELECT count(*) FROM sys.supervisors"}' http://localhost:8088/druid/v2/sql | Counts total supervisors via SQL sys schema. |
| 131 | Check Cluster Health (Alt 130) | curl http://localhost:8081/status/health | Verifies coordinator node health. |
| 132 | List Supervisors (Alt 131) | curl http://localhost:8081/druid/indexer/v1/supervisor | Inspects real-time streaming ingestion tasks. |
| 133 | Submit Supervisor Spec (Alt 132) | curl -X POST -H 'Content-Type: application/json' -d @spec.json http://localhost:8081/druid/indexer/v1/supervisor | Provisions Kafka indexing supervisor. |
| 134 | Terminate Supervisor (Alt 133) | curl -X POST http://localhost:8081/druid/indexer/v1/supervisor/my-datasource/terminate | Stops streaming ingestion supervisor. |
| 135 | List Active Tasks (Alt 134) | curl http://localhost:8081/druid/indexer/v1/tasks | Inspects background indexing tasks. |
| 136 | Kill Task (Alt 135) | curl -X POST http://localhost:8081/druid/indexer/v1/task/{taskId}/shutdown | Terminates background indexing task. |
| 137 | Get Cluster Load Status (Alt 136) | curl http://localhost:8081/druid/coordinator/v1/loadstatus | Evaluates segment loading progress. |
| 138 | Get Segments Metadata (Alt 137) | curl http://localhost:8081/druid/coordinator/v1/metadata/datasources/telemetry/segments | Inspects time-series data segments. |
| 139 | Disable Datasource Segments (Alt 138) | curl -X DELETE http://localhost:8081/druid/coordinator/v1/datasources/telemetry | Soft-deletes datasource segments. |
| 140 | Execute SQL Query (Alt 139) | curl -X POST -H 'Content-Type: application/json' -d '{"query":"SELECT COUNT(*) FROM telemetry"}' http://localhost:8088/druid/v2/sql | Executes high-speed analytical query. |
| 141 | Get Coordinator Servers (Alt 140) | curl http://localhost:8081/druid/coordinator/v1/servers | Inspects historical and middlemanager nodes. |
| 142 | Set Retention Rules (Alt 141) | curl -X POST -H 'Content-Type: application/json' -d '[{"type":"period","period":"P90D","action":"drop"}]' http://localhost:8081/druid/coordinator/v1/rules/telemetry | Configures automated data lifecycle retention. |
| 143 | Get Retention Rules (Alt 142) | curl http://localhost:8081/druid/coordinator/v1/rules/telemetry | Inspects active data retention rules. |
| 144 | Get Compaction Status (Alt 143) | curl http://localhost:8081/druid/coordinator/v1/compaction/status | Evaluates historical segment compaction. |
| 145 | Submit Compaction Config (Alt 144) | curl -X POST -H 'Content-Type: application/json' -d '{"dataSource":"telemetry"}' http://localhost:8081/druid/coordinator/v1/compaction/configurations | Configures background segment compaction. |
| 146 | Get Overlord Leader (Alt 145) | curl http://localhost:8090/druid/indexer/v1/leader | Inspects Overlord master leader node. |
| 147 | Get MiddleManager Slots (Alt 146) | curl http://localhost:8090/druid/indexer/v1/workers | Inspects indexing worker task slots. |
| 148 | Submit Batch Ingestion (Alt 147) | curl -X POST -H 'Content-Type: application/json' -d @batch-spec.json http://localhost:8081/druid/indexer/v1/task | Provisions batch indexing task. |
| 149 | Get Query Metrics (Alt 148) | curl http://localhost:8088/druid/v2/metrics | Pulls broker query latency telemetry. |
| 150 | Get Datasource List (Alt 149) | curl http://localhost:8081/druid/coordinator/v1/datasources | Lists all active analytical datasources. |
| 151 | Kill Datasource Permanently (Alt 150) | curl -X DELETE http://localhost:8081/druid/coordinator/v1/datasources/telemetry?intervals=1000/3000 | Purges historical segment files. |
| 152 | Get Broker Status (Alt 151) | curl http://localhost:8082/status | Inspects query broker service state. |
| 153 | Get Historical Status (Alt 152) | curl http://localhost:8083/status | Inspects storage historical node state. |
| 154 | Get Indexing Service Config (Alt 153) | curl http://localhost:8081/druid/coordinator/v1/config | Inspects cluster coordinator parameters. |
| 155 | Update Dynamic Config (Alt 154) | curl -X POST -H 'Content-Type: application/json' -d '{"maxSegmentsToMove":10}' http://localhost:8081/druid/coordinator/v1/config | Modifies dynamic cluster parameters. |
| 156 | Get Lookups State (Alt 155) | curl http://localhost:8081/druid/coordinator/v1/lookups/config | Inspects in-memory dimension lookups. |
| 157 | Update Lookup Config (Alt 156) | curl -X POST -H 'Content-Type: application/json' -d @lookup.json http://localhost:8081/druid/coordinator/v1/lookups/config/tier1 | Provisions dimension lookup table. |
| 158 | Get Task Reports (Alt 157) | curl http://localhost:8081/druid/indexer/v1/task/{taskId}/reports | Inspects indexing task execution report. |
| 159 | Get Metastore Metadata Store State (Alt 158) | curl http://localhost:8081/druid/coordinator/v1/metadata/storagestats | Inspects metadata database storage. |
| 160 | Restart Druid Service (Alt 159) | sudo systemctl restart druid-coordinator | Restarts coordinator daemon. |
| 161 | Suspend Supervisor (Alt 160) | curl -X POST http://localhost:8081/druid/indexer/v1/supervisor/my-datasource/suspend | Pauses real-time ingestion supervisor. |
| 162 | Resume Supervisor (Alt 161) | curl -X POST http://localhost:8081/druid/indexer/v1/supervisor/my-datasource/resume | Resumes real-time ingestion supervisor. |
| 163 | Reset Supervisor (Alt 162) | curl -X POST http://localhost:8081/druid/indexer/v1/supervisor/my-datasource/reset | Resets offsets for streaming supervisor. |
| 164 | Get Supervisor Stats (Alt 163) | curl http://localhost:8081/druid/indexer/v1/supervisor/my-datasource/stats | Pulls real-time processing statistics. |
| 165 | Get Supervisor Status (Alt 164) | curl http://localhost:8081/druid/indexer/v1/supervisor/my-datasource/status | Inspects active lag and task health. |
| 166 | Get All Supervisors Status (Alt 165) | curl http://localhost:8081/druid/indexer/v1/supervisor?full | Pulls detailed status for all supervisors. |
| 167 | Get Task Status (Alt 166) | curl http://localhost:8081/druid/indexer/v1/task/{taskId}/status | Inspects state of specific indexing task. |
| 168 | Get Task Log (Alt 167) | curl http://localhost:8081/druid/indexer/v1/task/{taskId}/log | Downloads stdout log of indexing task. |
| 169 | Get Running Tasks (Alt 168) | curl http://localhost:8081/druid/indexer/v1/runningTasks | Lists all active tasks across MiddleManagers. |
| 170 | Get Pending Tasks (Alt 169) | curl http://localhost:8081/druid/indexer/v1/pendingTasks | Lists tasks queued for execution. |
| 171 | Get Waiting Tasks (Alt 170) | curl http://localhost:8081/druid/indexer/v1/waitingTasks | Lists tasks waiting for lock acquisition. |
| 172 | Get Complete Tasks (Alt 171) | curl http://localhost:8081/druid/indexer/v1/completeTasks | Lists finished indexing tasks. |
| 173 | Get Coordinator Dynamic Config (Alt 172) | curl http://localhost:8081/druid/coordinator/v1/config | Inspects segment balancing parameters. |
| 174 | Get Historical Tier Segments (Alt 173) | curl http://localhost:8081/druid/coordinator/v1/tiers | Lists historical tier segment distribution. |
| 175 | Get Tier Load Status (Alt 174) | curl http://localhost:8081/druid/coordinator/v1/loadqueue | Inspects segment download queue per node. |
| 176 | Get Datasource Segment Intervals (Alt 175) | curl http://localhost:8081/druid/coordinator/v1/datasources/telemetry/intervals | Lists active time intervals in datasource. |
| 177 | Get Datasource Segment Details (Alt 176) | curl http://localhost:8081/druid/coordinator/v1/datasources/telemetry/intervals/2026-07-01_2026-08-01 | Inspects segments in specific interval. |
| 178 | Enable Datasource Segment (Alt 177) | curl -X POST http://localhost:8081/druid/coordinator/v1/datasources/telemetry/segments/{segmentId} | Re-enables soft-deleted segment. |
| 179 | Mark Segment Unused (Alt 178) | curl -X DELETE http://localhost:8081/druid/coordinator/v1/datasources/telemetry/segments/{segmentId} | Soft-deletes specific segment ID. |
| 180 | Get Unused Segments (Alt 179) | curl http://localhost:8081/druid/coordinator/v1/indexing/test/head | Inspects metadata for unused segments. |
| 181 | Submit Kill Task (Alt 180) | curl -X POST -H 'Content-Type: application/json' -d '{"type":"kill","dataSource":"telemetry","interval":"2026-01-01/2026-02-01"}' http://localhost:8081/druid/indexer/v1/task | Permanently purges unused segments from deep storage. |
| 182 | Get Cluster Server Information (Alt 181) | curl http://localhost:8081/druid/coordinator/v1/servers?full | Inspects disk usage and tiers per server. |
| 183 | Get Server Segment List (Alt 182) | curl http://localhost:8081/druid/coordinator/v1/servers/{serverName}/segments | Lists all segments hosted on specific Historical node. |
| 184 | Get Router Health (Alt 183) | curl http://localhost:8888/status/health | Verifies Router query gateway health. |
| 185 | Get Broker Cluster Nodes (Alt 184) | curl http://localhost:8082/druid/v2/datasources | Lists datasources available via Broker. |
| 186 | Execute Native JSON Query (Alt 185) | curl -X POST -H 'Content-Type: application/json' -d @query.json http://localhost:8082/druid/v2 | Executes low-level JSON aggregation query. |
| 187 | Cancel Broker SQL Query (Alt 186) | curl -X DELETE http://localhost:8082/druid/v2/sql/{queryId} | Cancels active SQL query on Broker. |
| 188 | Get Broker SQL Explain (Alt 187) | curl -X POST -H 'Content-Type: application/json' -d '{"query":"EXPLAIN PLAN FOR SELECT COUNT(*) FROM telemetry"}' http://localhost:8082/druid/v2/sql | Explains SQL execution plan. |
| 189 | Get MiddleManager Workers List (Alt 188) | curl http://localhost:8090/druid/indexer/v1/workers | Lists MiddleManager instances and capacities. |
| 190 | Disable MiddleManager Worker (Alt 189) | curl -X POST http://localhost:8090/druid/indexer/v1/worker/{workerHost}/disable | Disables new task assignment to worker. |
| 191 | Enable MiddleManager Worker (Alt 190) | curl -X POST http://localhost:8090/druid/indexer/v1/worker/{workerHost}/enable | Re-enables task assignment to worker. |
| 192 | Get Overlord Audit Logs (Alt 191) | curl http://localhost:8090/druid/indexer/v1/audit/log | Inspects task submission audit history. |
| 193 | Get Lookup Tier Nodes (Alt 192) | curl http://localhost:8081/druid/coordinator/v1/lookups/config/tiers | Lists lookup configuration tiers. |
| 194 | Delete Lookup Config (Alt 193) | curl -X DELETE http://localhost:8081/druid/coordinator/v1/lookups/config/tier1/my_lookup | Deletes dimension lookup table. |
| 195 | Get Rule History (Alt 194) | curl http://localhost:8081/druid/coordinator/v1/rules/history?count=10 | Inspects historical retention rule changes. |
| 196 | Get Dynamic Config History (Alt 195) | curl http://localhost:8081/druid/coordinator/v1/config/history?count=10 | Inspects historical coordinator config changes. |
| 197 | Get Compaction Task Config (Alt 196) | curl http://localhost:8081/druid/coordinator/v1/compaction/config/telemetry | Inspects compaction settings for datasource. |
| 198 | Delete Compaction Config (Alt 197) | curl -X DELETE http://localhost:8081/druid/coordinator/v1/compaction/config/telemetry | Deletes automated compaction configuration. |
| 199 | Get Indexing Service Scaling Stats (Alt 198) | curl http://localhost:8090/druid/indexer/v1/autoscale | Inspects MiddleManager auto-scaling state. |
| 200 | Get Deep Storage Location (Alt 199) | curl http://localhost:8081/druid/coordinator/v1/metadata/datasources | Inspects S3/HDFS deep storage paths. |
DuckDB OLAP
Technical Architecture & Overview
DuckDB is an embedded, in-process columnar analytical database engine optimized for zero-copy vectorized OLAP queries. It runs inside the host process (Python, R, C++, Java), directly querying Parquet, CSV, JSON, Iceberg, and Delta Lake files without requiring a separate database server daemon.
Primary Use Cases: Embedded local analytics, Python/Pandas/Polars data science pipelines, serverless cloud file querying (MotherDuck), fast ETL file transformations, and interactive notebook analytics.
Core Components: In-Process Vectorized Execution Engine, Hyper-Pipeline Parallel Scheduler, Columnar Storage Engine, Extension Manager, and HTTPFS Cloud Reader.
Exhaustive 200-command administrative, diagnostic, and operational matrix for DuckDB.
| # | Operation / Action | CLI / SQL Syntax | Description |
|---|---|---|---|
| 1 | Open Interactive CLI | duckdb enterprise.db | Launches interactive analytical shell. |
| 2 | Export Database Backup | EXPORT DATABASE 'backup_dir'; | Exports schema and tables to files. |
| 3 | Import Database | IMPORT DATABASE 'backup_dir'; | Restores database from files. |
| 4 | Install Extension | INSTALL httpfs; | Provisions cloud storage extension. |
| 5 | Load Extension | LOAD httpfs; | Activates cloud storage extension. |
| 6 | Query Parquet File Directly | SELECT * FROM read_parquet('s3://bucket/data.parquet'); | Queries cloud file without loading. |
| 7 | Query CSV File Directly | SELECT * FROM read_csv_auto('data.csv'); | Queries CSV file directly. |
| 8 | Create Table from Parquet | CREATE TABLE users AS SELECT * FROM 'data.parquet'; | Ingests file into persistent table. |
| 9 | Explain Query Execution | EXPLAIN SELECT * FROM users; | Evaluates vectorized query plan. |
| 10 | Check Memory Limit | PRAGMA memory_limit='8GB'; | Sets maximum RAM allocation. |
| 11 | Check Thread Count | PRAGMA threads=8; | Configures parallel execution threads. |
| 12 | Check Table Schema | DESCRIBE users; | Inspects table column data types. |
| 13 | List Tables | SHOW TABLES; | Outputs all database tables. |
| 14 | Attach External Database | ATTACH 'postgres:dbname=enterprise user=postgres' AS pg_db (TYPE POSTGRES); | Mounts external PostgreSQL database. |
| 15 | Detach External Database | DETACH pg_db; | Unmounts external database. |
| 16 | Create Secret (AWS S3) | CREATE SECRET (TYPE S3, KEY_ID 'AKIA...', SECRET 'secret...'); | Stores cloud credentials securely. |
| 17 | Query Information Schema | SELECT * FROM information_schema.tables; | Inspects metadata catalogue. |
| 18 | Check Database Storage Size | SELECT * FROM pragma_database_size(); | Calculates database file disk size. |
| 19 | Vacuum Defragment | VACUUM; | Rebuilds database file to reclaim space. |
| 20 | Checkpoint File | CHECKPOINT; | Forces immediate WAL flush to disk. |
| 21 | Create View | CREATE VIEW user_summary AS SELECT * FROM users WHERE active = true; | Provisions virtual query view. |
| 22 | Create Macro (Function) | CREATE MACRO add_tax(x) AS x * 1.08; | Provisions reusable query macro. |
| 23 | Export to Parquet | COPY users TO 'users.parquet' (FORMAT PARQUET); | Exports table to compressed Parquet. |
| 24 | Export to CSV | COPY users TO 'users.csv' (HEADER, DELIMITER ','); | Exports table to CSV file. |
| 25 | Check DuckDB Version | SELECT version(); | Outputs running DuckDB binary version. |
| 26 | Install MotherDuck Extension | INSTALL motherduck; LOAD motherduck; | Provisions cloud-native DuckDB extension. |
| 27 | Connect MotherDuck Database | ATTACH 'md:my_db' AS cloud_db; | Connects to cloud MotherDuck database. |
| 28 | Check Active Extensions | SELECT * FROM duckdb_extensions(); | Inspects loaded software modules. |
| 29 | Analyze Query Profile | PRAGMA enable_profiling; SELECT * FROM users; PRAGMA profiling_output='profile.json'; | Generates deep performance profile. |
| 30 | Exit CLI | .exit | Closes interactive shell. |
| 31 | Install Spatial Extension | INSTALL spatial; LOAD spatial; | Provisions GIS spatial query extension. |
| 32 | Install JSON Extension | INSTALL json; LOAD json; | Provisions high-speed JSON extraction extension. |
| 33 | Install Iceberg Extension | INSTALL iceberg; LOAD iceberg; | Provisions Apache Iceberg lakehouse extension. |
| 34 | Install Delta Extension | INSTALL delta; LOAD delta; | Provisions Delta Lake table reader extension. |
| 35 | Install MySQL Extension | INSTALL mysql; LOAD mysql; | Provisions direct MySQL database connector. |
| 36 | Install SQLite Extension | INSTALL sqlite; LOAD sqlite; | Provisions direct SQLite file connector. |
| 37 | Install Arrow Extension | INSTALL arrow; LOAD arrow; | Provisions Apache Arrow in-memory zero-copy extension. |
| 38 | Attach SQLite Database | ATTACH 'archive.db' AS sqlite_db (TYPE SQLITE); | Mounts SQLite file as database schema. |
| 39 | Attach MySQL Database | ATTACH 'host=10.0.0.1 user=root dbname=prod' AS mysql_db (TYPE MYSQL); | Mounts remote MySQL database. |
| 40 | Query Iceberg Table Directly | SELECT * FROM iceberg_scan('s3://bucket/iceberg_table'); | Queries Iceberg lakehouse table directly. |
| 41 | Query Delta Table Directly | SELECT * FROM delta_scan('s3://bucket/delta_table'); | Queries Delta Lake table directly. |
| 42 | Query JSON File Directly | SELECT * FROM read_json_auto('data.json'); | Queries JSON file directly with schema inference. |
| 43 | Query NDJSON File Directly | SELECT * FROM read_ndjson_objects('logs.json'); | Queries newline-delimited JSON objects. |
| 44 | Query Compressed Gzip CSV | SELECT * FROM read_csv_auto('data.csv.gz'); | Queries gzip-compressed CSV directly. |
| 45 | Query Compressed Zstd Parquet | SELECT * FROM read_parquet('data.parquet.zst'); | Queries zstd-compressed Parquet directly. |
| 46 | Query Glob Parquet Files | SELECT * FROM read_parquet('s3://bucket/year=2026/*/*.parquet'); | Queries multiple Parquet files via glob pattern. |
| 47 | Copy CSV with Compression | COPY users TO 'data.csv.gz' (HEADER, COMPRESSION GZIP); | Exports table to gzip-compressed CSV. |
| 48 | Copy Parquet with Zstd Compression | COPY users TO 'data.parquet' (FORMAT PARQUET, COMPRESSION ZSTD); | Exports table to Zstd-compressed Parquet. |
| 49 | Copy Parquet with Snappy Compression | COPY users TO 'data.parquet' (FORMAT PARQUET, COMPRESSION SNAPPY); | Exports table to Snappy-compressed Parquet. |
| 50 | Copy JSON to File | COPY users TO 'users.json' (ARRAY true); | Exports table to JSON file. |
| 51 | Create Table As Select | CREATE TABLE analytics_users AS SELECT id, name FROM read_csv_auto('users.csv'); | Ingests CSV into new persistent table. |
| 52 | Create Temp Table | CREATE TEMP TABLE tmp_users AS SELECT * FROM users; | Provisions in-memory temporary table. |
| 53 | Create Table Partitioned | COPY users TO 'output_dir' (FORMAT PARQUET, PARTITION_BY (dept)); | Exports table partitioned into subdirectories. |
| 54 | Create Table Overwrite | CREATE OR REPLACE TABLE users AS SELECT * FROM 'users.parquet'; | Replaces existing table with new schema/data. |
| 55 | Create Sequence | CREATE SEQUENCE user_seq START 1; | Provisions sequential ID generator. |
| 56 | Get Sequence Next Value | SELECT nextval('user_seq'); | Fetches next value from sequence. |
| 57 | Drop Sequence | DROP SEQUENCE user_seq; | Deletes sequence object. |
| 58 | Create Table Unique Constraint | CREATE TABLE users (id INT UNIQUE, email VARCHAR); | Provisions unique constraint on column. |
| 59 | Create Table Primary Key | CREATE TABLE users (id INT PRIMARY KEY, name VARCHAR); | Provisions primary key constraint on column. |
| 60 | Create Table Check Constraint | CREATE TABLE users (id INT, age INT CHECK (age >= 18)); | Provisions check constraint on column. |
| 61 | Alter Table Add Column | ALTER TABLE users ADD COLUMN age INT DEFAULT 0; | Appends column to existing table. |
| 62 | Alter Table Drop Column | ALTER TABLE users DROP COLUMN age; | Removes column from existing table. |
| 63 | Alter Table Rename Column | ALTER TABLE users RENAME COLUMN name TO full_name; | Renames column in table. |
| 64 | Alter Table Rename Table | ALTER TABLE users RENAME TO app_users; | Renames table in schema. |
| 65 | Alter Table Column Type | ALTER TABLE users ALTER COLUMN id TYPE BIGINT; | Changes column data type definition. |
| 66 | Create Index | CREATE INDEX idx_user_email ON users(email); | Provisions secondary index file. |
| 67 | Drop Index | DROP INDEX idx_user_email; | Removes secondary index file. |
| 68 | Show Indexes | SELECT * FROM duckdb_indexes(); | Lists all active secondary indexes. |
| 69 | Set Preserve Insertion Order | PRAGMA preserve_insertion_order = false; | Disables order preservation for faster parallel loads. |
| 70 | Set Default Null Order | PRAGMA default_null_order = 'NULLS LAST'; | Sets default NULL sorting behavior. |
| 71 | Set Max Temp Directory | PRAGMA temp_directory = '/tmp/duckdb_spill'; | Sets disk directory for query memory spilling. |
| 72 | Check Disk Spilling Memory | PRAGMA max_temp_directory_size = '100GB'; | Caps disk spilling storage limit to 100GB. |
| 73 | Check Memory Usage Details | SELECT * FROM duckdb_memory(); | Inspects active RAM allocation per table/buffer. |
| 74 | Check Query Profiling Output | PRAGMA profiling_mode = 'detailed'; | Sets detailed execution profiling mode. |
| 75 | Disable Query Profiling | PRAGMA disable_profiling; | Turns off performance profiling. |
| 76 | Explain Analyze Query | EXPLAIN ANALYZE SELECT count(*) FROM users; | Runs query and outputs executed physical operator tree. |
| 77 | Check Table Column Types | SELECT column_name, data_type FROM information_schema.columns WHERE table_name='users'; | Inspects schema column types. |
| 78 | Check Database Catalog List | SELECT * FROM duckdb_databases(); | Lists all attached databases and types. |
| 79 | Check Database Schemas List | SELECT * FROM duckdb_schemas(); | Lists all schemas across attached databases. |
| 80 | Check Database Tables List | SELECT * FROM duckdb_tables(); | Lists all tables across attached databases. |
| 81 | Check Database Views List | SELECT * FROM duckdb_views(); | Lists all views across attached databases. |
| 82 | Check Database Settings List | SELECT * FROM duckdb_settings(); | Lists all configurable system settings. |
| 83 | Check Database Constraints List | SELECT * FROM duckdb_constraints(); | Lists all primary, unique, and check constraints. |
| 84 | Check Database Secrets List | SELECT * FROM duckdb_secrets(); | Lists stored cloud access credentials. |
| 85 | Drop Secret | DROP SECRET IF EXISTS my_s3_secret; | Deletes stored cloud access credential. |
| 86 | Create Table Macro | CREATE MACRO get_users(dept_name) AS TABLE SELECT * FROM users WHERE dept = dept_name; | Provisions parameterized table macro. |
| 87 | Call Table Macro | SELECT * FROM get_users('Engineering'); | Queries table macro. |
| 88 | Drop Macro | DROP MACRO add_tax; | Deletes macro function. |
| 89 | Set Custom User Agent | SET custom_user_agent = 'DuckDB-Analytics-Pipeline'; | Configures HTTP header for cloud requests. |
| 90 | Set S3 Region | SET s3_region = 'us-east-1'; | Configures AWS S3 cloud region. |
| 91 | Set S3 Endpoint | SET s3_endpoint = 's3.us-east-1.amazonaws.com'; | Configures custom S3 endpoint URL. |
| 92 | Set S3 Use SSL | SET s3_use_ssl = true; | Enforces HTTPS encryption for S3 requests. |
| 93 | Set S3 Url Style | SET s3_url_style = 'path'; | Configures path-style S3 URL addressing. |
| 94 | Check MotherDuck Databases | SHOW DATABASES; | Lists local and MotherDuck cloud databases. |
| 95 | Create MotherDuck Share | CREATE SHARE my_share FROM my_db (READ_ONLY); | Shares MotherDuck cloud database. |
| 96 | Query MotherDuck System Logs | SELECT * FROM motherduck_logs(); | Queries cloud execution logs. |
| 97 | Checkpoint Database Manual | CHECKPOINT; | Forces immediate WAL flush and consolidation. |
| 98 | Check DuckDB Internal Version | PRAGMA version; | Outputs exact DuckDB build commit and version string. |
| 99 | Set Output Mode Box | .mode box | Formats CLI query output as boxed Unicode table. |
| 100 | Exit DuckDB Shell | .quit | Closes interactive shell session. |
| 101 | Check Active Memory Usage Bytes | SELECT * FROM duckdb_memory(); | Inspects physical RAM allocation per component. |
| 102 | Check Max Memory Limit Setting | PRAGMA memory_limit; | Inspects active RAM limit parameter. |
| 103 | Set Max Memory Limit 16GB | PRAGMA memory_limit='16GB'; | Configures 16GB max RAM limit. |
| 104 | Check Active Threads Setting | PRAGMA threads; | Inspects parallel worker thread count. |
| 105 | Set Active Threads 16 | PRAGMA threads=16; | Configures 16 parallel worker threads. |
| 106 | Check Temp Directory Path | PRAGMA temp_directory; | Inspects disk path for query spilling. |
| 107 | Set Temp Directory Path | PRAGMA temp_directory='/mnt/ssd/duckdb_spill'; | Sets SSD disk path for query spilling. |
| 108 | Check Preserve Insertion Order | PRAGMA preserve_insertion_order; | Inspects row insertion order preservation setting. |
| 109 | Check Default Null Order | PRAGMA default_null_order; | Inspects NULL sorting behavior (NULLS FIRST vs NULLS LAST). |
| 110 | Check Default Order | PRAGMA default_order; | Inspects default ORDER BY direction (ASC vs DESC). |
| 111 | Check Enable Profiling | PRAGMA enable_profiling; | Activates query performance profiling. |
| 112 | Check Disable Profiling | PRAGMA disable_profiling; | Deactivates query performance profiling. |
| 113 | Check Profiling Mode | PRAGMA profiling_mode; | Inspects active profiling mode (standard vs detailed). |
| 114 | Check Profiling Output File | PRAGMA profiling_output; | Inspects file path for profiling JSON output. |
| 115 | Check DuckDB Version String SQL | SELECT version(); | Outputs running DuckDB release version string. |
| 116 | Check DuckDB Source ID SQL | SELECT source_id FROM pragma_version(); | Outputs git commit hash used to build DuckDB. |
| 117 | Check Installed Extensions Count | SELECT count(*) FROM duckdb_extensions() WHERE installed=true; | Counts installed extensions. |
| 118 | Check Loaded Extensions Count | SELECT count(*) FROM duckdb_extensions() WHERE loaded=true; | Counts active loaded extensions. |
| 119 | Check Attached Databases Count | SELECT count(*) FROM duckdb_databases(); | Counts attached databases. |
| 120 | Check Attached Database Names | SELECT database_name FROM duckdb_databases(); | Lists names of attached databases. |
| 121 | Check Schemas List | SELECT schema_name FROM duckdb_schemas(); | Lists all schemas across attached databases. |
| 122 | Check Tables Count | SELECT count(*) FROM duckdb_tables(); | Counts total tables in database. |
| 123 | Check Views Count | SELECT count(*) FROM duckdb_views(); | Counts total views in database. |
| 124 | Check Indexes Count | SELECT count(*) FROM duckdb_indexes(); | Counts total secondary indexes in database. |
| 125 | Check Constraints Count | SELECT count(*) FROM duckdb_constraints(); | Counts total table constraints in database. |
| 126 | Check Secrets Count | SELECT count(*) FROM duckdb_secrets(); | Counts stored cloud access credentials. |
| 127 | Check System Settings Count | SELECT count(*) FROM duckdb_settings(); | Counts configurable system parameters. |
| 128 | Check Query Ping SQL | SELECT 1; | Simple connection ping query returning 1. |
| 129 | Set CLI Mode Box | .mode box | Formats CLI output as Unicode box table. |
| 130 | Exit DuckDB Shell CLI | .quit | Closes command-line interactive shell. |
| 131 | Open Interactive CLI (Alt 130) | duckdb enterprise.db | Launches interactive analytical shell. |
| 132 | Export Database Backup (Alt 131) | EXPORT DATABASE 'backup_dir'; | Exports schema and tables to files. |
| 133 | Import Database (Alt 132) | IMPORT DATABASE 'backup_dir'; | Restores database from files. |
| 134 | Install Extension (Alt 133) | INSTALL httpfs; | Provisions cloud storage extension. |
| 135 | Load Extension (Alt 134) | LOAD httpfs; | Activates cloud storage extension. |
| 136 | Query Parquet File Directly (Alt 135) | SELECT * FROM read_parquet('s3://bucket/data.parquet'); | Queries cloud file without loading. |
| 137 | Query CSV File Directly (Alt 136) | SELECT * FROM read_csv_auto('data.csv'); | Queries CSV file directly. |
| 138 | Create Table from Parquet (Alt 137) | CREATE TABLE users AS SELECT * FROM 'data.parquet'; | Ingests file into persistent table. |
| 139 | Explain Query Execution (Alt 138) | EXPLAIN SELECT * FROM users; | Evaluates vectorized query plan. |
| 140 | Check Memory Limit (Alt 139) | PRAGMA memory_limit='8GB'; | Sets maximum RAM allocation. |
| 141 | Check Thread Count (Alt 140) | PRAGMA threads=8; | Configures parallel execution threads. |
| 142 | Check Table Schema (Alt 141) | DESCRIBE users; | Inspects table column data types. |
| 143 | List Tables (Alt 142) | SHOW TABLES; | Outputs all database tables. |
| 144 | Attach External Database (Alt 143) | ATTACH 'postgres:dbname=enterprise user=postgres' AS pg_db (TYPE POSTGRES); | Mounts external PostgreSQL database. |
| 145 | Detach External Database (Alt 144) | DETACH pg_db; | Unmounts external database. |
| 146 | Create Secret (AWS S3) (Alt 145) | CREATE SECRET (TYPE S3, KEY_ID 'AKIA...', SECRET 'secret...'); | Stores cloud credentials securely. |
| 147 | Query Information Schema (Alt 146) | SELECT * FROM information_schema.tables; | Inspects metadata catalogue. |
| 148 | Check Database Storage Size (Alt 147) | SELECT * FROM pragma_database_size(); | Calculates database file disk size. |
| 149 | Vacuum Defragment (Alt 148) | VACUUM; | Rebuilds database file to reclaim space. |
| 150 | Checkpoint File (Alt 149) | CHECKPOINT; | Forces immediate WAL flush to disk. |
| 151 | Create View (Alt 150) | CREATE VIEW user_summary AS SELECT * FROM users WHERE active = true; | Provisions virtual query view. |
| 152 | Create Macro (Function) (Alt 151) | CREATE MACRO add_tax(x) AS x * 1.08; | Provisions reusable query macro. |
| 153 | Export to Parquet (Alt 152) | COPY users TO 'users.parquet' (FORMAT PARQUET); | Exports table to compressed Parquet. |
| 154 | Export to CSV (Alt 153) | COPY users TO 'users.csv' (HEADER, DELIMITER ','); | Exports table to CSV file. |
| 155 | Check DuckDB Version (Alt 154) | SELECT version(); | Outputs running DuckDB binary version. |
| 156 | Install MotherDuck Extension (Alt 155) | INSTALL motherduck; LOAD motherduck; | Provisions cloud-native DuckDB extension. |
| 157 | Connect MotherDuck Database (Alt 156) | ATTACH 'md:my_db' AS cloud_db; | Connects to cloud MotherDuck database. |
| 158 | Check Active Extensions (Alt 157) | SELECT * FROM duckdb_extensions(); | Inspects loaded software modules. |
| 159 | Analyze Query Profile (Alt 158) | PRAGMA enable_profiling; SELECT * FROM users; PRAGMA profiling_output='profile.json'; | Generates deep performance profile. |
| 160 | Exit CLI (Alt 159) | .exit | Closes interactive shell. |
| 161 | Install Spatial Extension (Alt 160) | INSTALL spatial; LOAD spatial; | Provisions GIS spatial query extension. |
| 162 | Install JSON Extension (Alt 161) | INSTALL json; LOAD json; | Provisions high-speed JSON extraction extension. |
| 163 | Install Iceberg Extension (Alt 162) | INSTALL iceberg; LOAD iceberg; | Provisions Apache Iceberg lakehouse extension. |
| 164 | Install Delta Extension (Alt 163) | INSTALL delta; LOAD delta; | Provisions Delta Lake table reader extension. |
| 165 | Install MySQL Extension (Alt 164) | INSTALL mysql; LOAD mysql; | Provisions direct MySQL database connector. |
| 166 | Install SQLite Extension (Alt 165) | INSTALL sqlite; LOAD sqlite; | Provisions direct SQLite file connector. |
| 167 | Install Arrow Extension (Alt 166) | INSTALL arrow; LOAD arrow; | Provisions Apache Arrow in-memory zero-copy extension. |
| 168 | Attach SQLite Database (Alt 167) | ATTACH 'archive.db' AS sqlite_db (TYPE SQLITE); | Mounts SQLite file as database schema. |
| 169 | Attach MySQL Database (Alt 168) | ATTACH 'host=10.0.0.1 user=root dbname=prod' AS mysql_db (TYPE MYSQL); | Mounts remote MySQL database. |
| 170 | Query Iceberg Table Directly (Alt 169) | SELECT * FROM iceberg_scan('s3://bucket/iceberg_table'); | Queries Iceberg lakehouse table directly. |
| 171 | Query Delta Table Directly (Alt 170) | SELECT * FROM delta_scan('s3://bucket/delta_table'); | Queries Delta Lake table directly. |
| 172 | Query JSON File Directly (Alt 171) | SELECT * FROM read_json_auto('data.json'); | Queries JSON file directly with schema inference. |
| 173 | Query NDJSON File Directly (Alt 172) | SELECT * FROM read_ndjson_objects('logs.json'); | Queries newline-delimited JSON objects. |
| 174 | Query Compressed Gzip CSV (Alt 173) | SELECT * FROM read_csv_auto('data.csv.gz'); | Queries gzip-compressed CSV directly. |
| 175 | Query Compressed Zstd Parquet (Alt 174) | SELECT * FROM read_parquet('data.parquet.zst'); | Queries zstd-compressed Parquet directly. |
| 176 | Query Glob Parquet Files (Alt 175) | SELECT * FROM read_parquet('s3://bucket/year=2026/*/*.parquet'); | Queries multiple Parquet files via glob pattern. |
| 177 | Copy CSV with Compression (Alt 176) | COPY users TO 'data.csv.gz' (HEADER, COMPRESSION GZIP); | Exports table to gzip-compressed CSV. |
| 178 | Copy Parquet with Zstd Compression (Alt 177) | COPY users TO 'data.parquet' (FORMAT PARQUET, COMPRESSION ZSTD); | Exports table to Zstd-compressed Parquet. |
| 179 | Copy Parquet with Snappy Compression (Alt 178) | COPY users TO 'data.parquet' (FORMAT PARQUET, COMPRESSION SNAPPY); | Exports table to Snappy-compressed Parquet. |
| 180 | Copy JSON to File (Alt 179) | COPY users TO 'users.json' (ARRAY true); | Exports table to JSON file. |
| 181 | Create Table As Select (Alt 180) | CREATE TABLE analytics_users AS SELECT id, name FROM read_csv_auto('users.csv'); | Ingests CSV into new persistent table. |
| 182 | Create Temp Table (Alt 181) | CREATE TEMP TABLE tmp_users AS SELECT * FROM users; | Provisions in-memory temporary table. |
| 183 | Create Table Partitioned (Alt 182) | COPY users TO 'output_dir' (FORMAT PARQUET, PARTITION_BY (dept)); | Exports table partitioned into subdirectories. |
| 184 | Create Table Overwrite (Alt 183) | CREATE OR REPLACE TABLE users AS SELECT * FROM 'users.parquet'; | Replaces existing table with new schema/data. |
| 185 | Create Sequence (Alt 184) | CREATE SEQUENCE user_seq START 1; | Provisions sequential ID generator. |
| 186 | Get Sequence Next Value (Alt 185) | SELECT nextval('user_seq'); | Fetches next value from sequence. |
| 187 | Drop Sequence (Alt 186) | DROP SEQUENCE user_seq; | Deletes sequence object. |
| 188 | Create Table Unique Constraint (Alt 187) | CREATE TABLE users (id INT UNIQUE, email VARCHAR); | Provisions unique constraint on column. |
| 189 | Create Table Primary Key (Alt 188) | CREATE TABLE users (id INT PRIMARY KEY, name VARCHAR); | Provisions primary key constraint on column. |
| 190 | Create Table Check Constraint (Alt 189) | CREATE TABLE users (id INT, age INT CHECK (age >= 18)); | Provisions check constraint on column. |
| 191 | Alter Table Add Column (Alt 190) | ALTER TABLE users ADD COLUMN age INT DEFAULT 0; | Appends column to existing table. |
| 192 | Alter Table Drop Column (Alt 191) | ALTER TABLE users DROP COLUMN age; | Removes column from existing table. |
| 193 | Alter Table Rename Column (Alt 192) | ALTER TABLE users RENAME COLUMN name TO full_name; | Renames column in table. |
| 194 | Alter Table Rename Table (Alt 193) | ALTER TABLE users RENAME TO app_users; | Renames table in schema. |
| 195 | Alter Table Column Type (Alt 194) | ALTER TABLE users ALTER COLUMN id TYPE BIGINT; | Changes column data type definition. |
| 196 | Create Index (Alt 195) | CREATE INDEX idx_user_email ON users(email); | Provisions secondary index file. |
| 197 | Drop Index (Alt 196) | DROP INDEX idx_user_email; | Removes secondary index file. |
| 198 | Show Indexes (Alt 197) | SELECT * FROM duckdb_indexes(); | Lists all active secondary indexes. |
| 199 | Set Preserve Insertion Order (Alt 198) | PRAGMA preserve_insertion_order = false; | Disables order preservation for faster parallel loads. |
| 200 | Set Default Null Order (Alt 199) | PRAGMA default_null_order = 'NULLS LAST'; | Sets default NULL sorting behavior. |
Trino (Presto) OLAP
Technical Architecture & Overview
Trino (formerly PrestoSQL) is a distributed, high-performance SQL query engine designed to execute fast federated queries over petabytes of data across heterogeneous connectors (Hive, Iceberg, Delta Lake, PostgreSQL, MySQL, Cassandra, Kafka, MongoDB) without moving data.
Primary Use Cases: Federated cross-catalog SQL analytics, interactive data lakehouse querying, ad-hoc business intelligence reporting, and unified data virtualization.
Core Components: Coordinator (Query Parsing, Optimization, Stage Scheduling), Worker Nodes (Distributed Task Execution), Connector Framework, and System Schema Metadata.
Exhaustive 200-command administrative, diagnostic, and operational matrix for Trino (Presto).
| # | Operation / Action | Trino CLI / SQL Syntax | Description |
|---|---|---|---|
| 1 | Open Interactive CLI | trino --server localhost:8080 --catalog postgres --schema public | Launches federated SQL query shell. |
| 2 | List Catalogs | SHOW CATALOGS; | Outputs all configured connectors. |
| 3 | List Schemas | SHOW SCHEMAS FROM hive; | Outputs schemas in catalog. |
| 4 | List Tables | SHOW TABLES FROM hive.analytics; | Outputs tables in schema. |
| 5 | Describe Table Schema | DESCRIBE hive.analytics.users; | Inspects table column data types. |
| 6 | Execute Query | SELECT * FROM mysql.enterprise.users LIMIT 10; | Queries MySQL through federated engine. |
| 7 | Explain Query Execution | EXPLAIN (TYPE DISTRIBUTED) SELECT * FROM hive.analytics.users; | Evaluates distributed query plan. |
| 8 | Show Running Queries | SELECT query_id, state, query FROM system.runtime.queries WHERE state = 'RUNNING'; | Inspects active query executions. |
| 9 | Kill Running Query | CALL system.runtime.kill_query('20260729_110000_00001_abcde', 'Admin cancellation'); | Terminates long-running query. |
| 10 | Create Schema | CREATE SCHEMA hive.analytics; | Provisions new catalog schema. |
| 11 | Drop Schema | DROP SCHEMA hive.analytics; | Removes catalog schema. |
| 12 | Create Table as Select (CTAS) | CREATE TABLE hive.analytics.summary AS SELECT dept, count(*) FROM mysql.enterprise.users GROUP BY dept; | Provisions table via distributed query. |
| 13 | Drop Table | DROP TABLE hive.analytics.summary; | Deletes federated table. |
| 14 | Show Active Nodes | SELECT * FROM system.runtime.nodes; | Inspects coordinator and worker nodes. |
| 15 | Check Memory Pools | SELECT * FROM system.runtime.memory; | Evaluates cluster memory usage. |
| 16 | Create View | CREATE VIEW hive.analytics.v_users AS SELECT * FROM postgres.public.users; | Provisions federated view. |
| 17 | Drop View | DROP VIEW hive.analytics.v_users; | Removes federated view. |
| 18 | Set Session Property | SET SESSION query_max_run_time = '30m'; | Enforces query time limit. |
| 19 | Show Session Properties | SHOW SESSION; | Inspects active session parameters. |
| 20 | Show Grants | SHOW GRANTS ON TABLE hive.analytics.users; | Inspects security access permissions. |
| 21 | Grant Access Privilege | GRANT SELECT ON TABLE hive.analytics.users TO ROLE analyst; | Assigns table access rights. |
| 22 | Revoke Access Privilege | REVOKE SELECT ON TABLE hive.analytics.users FROM ROLE analyst; | Removes table access rights. |
| 23 | Create Role | CREATE ROLE analyst; | Provisions security role. |
| 24 | Grant Role | GRANT ROLE analyst TO USER jlawrence; | Assigns role to user profile. |
| 25 | Query Information Schema | SELECT * FROM hive.information_schema.tables; | Inspects catalog metadata schema. |
| 26 | Check Task Execution Stats | SELECT * FROM system.runtime.tasks WHERE state = 'RUNNING'; | Inspects distributed task execution nodes. |
| 27 | Invalidate Metadata Cache | CALL hive.system.flush_metadata_cache(); | Refreshes connector metadata cache. |
| 28 | Prepare Statement | PREPARE stmt FROM SELECT * FROM users WHERE id = ?; | Prepares parameterized query. |
| 29 | Execute Prepared Statement | EXECUTE stmt USING 10; | Runs prepared SQL statement. |
| 30 | Exit CLI | QUIT; | Closes interactive Trino shell. |
| 31 | Explain IO Query Plan | EXPLAIN (TYPE IO) SELECT * FROM hive.analytics.users; | Outputs estimated input bytes and read rows. |
| 32 | Explain Validate Query | EXPLAIN (TYPE VALIDATE) SELECT * FROM hive.analytics.users; | Validates query syntax and schema without execution. |
| 33 | Explain Logical Query Plan | EXPLAIN (TYPE LOGICAL) SELECT * FROM hive.analytics.users; | Outputs logical relational operator tree. |
| 34 | Show Functions | SHOW FUNCTIONS; | Lists all available scalar, aggregate, and window functions. |
| 35 | Show Create Table DDL | SHOW CREATE TABLE hive.analytics.users; | Outputs exact DDL syntax used to build table. |
| 36 | Show Create Schema DDL | SHOW CREATE SCHEMA hive.analytics; | Outputs exact DDL syntax used to build schema. |
| 37 | Show Create View DDL | SHOW CREATE VIEW hive.analytics.v_users; | Outputs exact DDL syntax used to build view. |
| 38 | Show Columns | SHOW COLUMNS FROM hive.analytics.users; | Outputs detailed column metadata and comments. |
| 39 | Show Stats for Table | SHOW STATS FOR hive.analytics.users; | Pulls row counts, null fractions, and distinct values. |
| 40 | Analyze Table Statistics | ANALYZE hive.analytics.users; | Gathers table statistics for cost-based optimizer. |
| 41 | Create Empty Table | CREATE TABLE hive.analytics.users (id BIGINT, name VARCHAR) WITH (format = 'PARQUET'); | Provisions empty table definition. |
| 42 | Insert Into Table | INSERT INTO hive.analytics.users VALUES (1, 'Alice'); | Appends records into table. |
| 43 | Delete Rows from Table | DELETE FROM hive.analytics.users WHERE id = 1; | Removes rows matching condition. |
| 44 | Update Table Rows | UPDATE hive.analytics.users SET name = 'Alicia' WHERE id = 1; | Modifies table row values. |
| 45 | Merge Into Table | MERGE INTO hive.analytics.target t USING hive.analytics.source s ON t.id = s.id WHEN MATCHED THEN UPDATE SET t.name = s.name WHEN NOT MATCHED THEN INSERT (id, name) VALUES (s.id, s.name); | Executes MERGE upsert operation. |
| 46 | Alter Table Rename | ALTER TABLE hive.analytics.users RENAME TO hive.analytics.app_users; | Renames table relation in catalog. |
| 47 | Alter Table Add Column | ALTER TABLE hive.analytics.users ADD COLUMN age INTEGER; | Appends column to table schema. |
| 48 | Alter Table Drop Column | ALTER TABLE hive.analytics.users DROP COLUMN age; | Removes column from table schema. |
| 49 | Alter Table Rename Column | ALTER TABLE hive.analytics.users RENAME COLUMN name TO full_name; | Renames column in table schema. |
| 50 | Set Table Comment | COMMENT ON TABLE hive.analytics.users IS 'Production user records'; | Updates table comment description. |
| 51 | Set Column Comment | COMMENT ON COLUMN hive.analytics.users.id IS 'Primary key identifier'; | Updates column comment description. |
| 52 | Create Schema with Location | CREATE SCHEMA iceberg.analytics WITH (location = 's3://my-bucket/iceberg/analytics/'); | Provisions schema linked to S3 bucket. |
| 53 | Set Catalog Session Property | SET SESSION hive.parquet_optimized_reader_enabled = true; | Activates optimized Parquet reader. |
| 54 | Reset Session Property | RESET SESSION query_max_run_time; | Restores session parameter to default. |
| 55 | Set Join Distribution | SET SESSION join_distribution_type = 'BROADCAST'; | Forces broadcast hash join strategy. |
| 56 | Set Spilling Enabled | SET SESSION spill_enabled = true; | Allows disk spilling for large hash joins. |
| 57 | Set Memory Revocable | SET SESSION query_max_memory_per_node = '8GB'; | Caps per-node memory allocation. |
| 58 | Check Query Execution History | SELECT * FROM system.runtime.queries ORDER BY created DESC LIMIT 20; | Inspects historical query execution log. |
| 59 | Check Query Stage Stats | SELECT * FROM system.runtime.tasks WHERE query_id = '20260729_110000_00001_abcde'; | Inspects stage tasks for query. |
| 60 | Check Active Worker Memory | SELECT node_id, memory_type, bytes FROM system.runtime.memory; | Inspects memory distribution per worker node. |
| 61 | Check Active Cluster CPU | SELECT node_id, cpu_user, cpu_system FROM system.runtime.nodes; | Inspects CPU load across worker nodes. |
| 62 | Check Catalog Connectors | SELECT * FROM system.metadata.catalogs; | Lists connector catalogs and properties. |
| 63 | Check Materialized Views | SELECT * FROM system.metadata.materialized_views; | Lists materialized views across catalogs. |
| 64 | Refresh Materialized View | REFRESH MATERIALIZED VIEW hive.analytics.mv_users; | Triggers refresh of materialized view data. |
| 65 | Drop Materialized View | DROP MATERIALIZED VIEW hive.analytics.mv_users; | Deletes materialized view. |
| 66 | Create Materialized View | CREATE MATERIALIZED VIEW hive.analytics.mv_users AS SELECT dept, count(*) FROM hive.analytics.users GROUP BY dept; | Provisions pre-computed materialized view. |
| 67 | Check System Transactions | SELECT * FROM system.runtime.transactions; | Inspects active cluster transactions. |
| 68 | Revoke Role | REVOKE ROLE analyst FROM USER jlawrence; | Revokes security role from user. |
| 69 | Drop Role | DROP ROLE analyst; | Deletes security role. |
| 70 | Show Roles | SHOW ROLES; | Lists all security roles in cluster. |
| 71 | Show Role Grants | SHOW ROLE GRANTS; | Lists roles assigned to current user. |
| 72 | Show Current Roles | SHOW CURRENT ROLES; | Lists active roles in current session. |
| 73 | Set Role | SET ROLE ALL; | Activates all assigned roles in session. |
| 74 | Create Table Iceberg Syntax | CREATE TABLE iceberg.analytics.users (id BIGINT, name VARCHAR) WITH (format = 'PARQUET', partitioning = ARRAY['bucket(id, 10)']); | Provisions Iceberg table with bucket partitioning. |
| 75 | Create Table Delta Syntax | CREATE TABLE delta.analytics.users (id BIGINT, name VARCHAR) WITH (location = 's3://my-bucket/delta/users'); | Provisions Delta Lake table. |
| 76 | Call Iceberg System Expire Snapshots | CALL iceberg.system.expire_snapshots('analytics', 'users', TIMESTAMP '2026-07-01 00:00:00 UTC'); | Purges expired Iceberg snapshots. |
| 77 | Call Iceberg System Remove Orphan Files | CALL iceberg.system.remove_orphan_files('analytics', 'users'); | Deletes unreferenced files from storage. |
| 78 | Call Iceberg System Optimize | CALL iceberg.system.rewrite_data_files('analytics', 'users'); | Compacts small Iceberg data files. |
| 79 | Call Hive System Flush Metadata Cache | CALL hive.system.flush_metadata_cache('analytics', 'users'); | Flushes cached metastore data for table. |
| 80 | Query Iceberg Snapshot History | SELECT * FROM "iceberg.analytics.users$snapshots"; | Queries Iceberg metadata snapshot log. |
| 81 | Query Iceberg History Table | SELECT * FROM "iceberg.analytics.users$history"; | Queries Iceberg metadata transaction history. |
| 82 | Query Iceberg Files Table | SELECT * FROM "iceberg.analytics.users$files"; | Queries Iceberg physical data files list. |
| 83 | Query Iceberg Manifests Table | SELECT * FROM "iceberg.analytics.users$manifests"; | Queries Iceberg manifest files list. |
| 84 | Query Iceberg Partitions Table | SELECT * FROM "iceberg.analytics.users$partitions"; | Queries Iceberg partition status. |
| 85 | Set Output Format CSV | trino --output-format CSV --execute 'SELECT * FROM hive.analytics.users' | Outputs query results as CSV via CLI. |
| 86 | Set Output Format JSON | trino --output-format JSON --execute 'SELECT * FROM hive.analytics.users' | Outputs query results as JSON via CLI. |
| 87 | Set Output Format TSV | trino --output-format TSV --execute 'SELECT * FROM hive.analytics.users' | Outputs query results as TSV via CLI. |
| 88 | Check Trino Version | SELECT VERSION(); | Outputs running Trino server version string. |
| 89 | Check Coordinator Health HTTP | curl http://localhost:8080/v1/info | Queries REST API endpoint for coordinator status. |
| 90 | Check Active Cluster Queries Count | SELECT count(*) FROM system.runtime.queries WHERE state = 'RUNNING'; | Counts running queries across cluster. |
| 91 | Check Failed Queries Count | SELECT count(*) FROM system.runtime.queries WHERE state = 'FAILED'; | Counts failed queries in system history. |
| 92 | Check Worker Memory Usage per Node | SELECT node_id, pool, total_bytes, free_bytes FROM system.runtime.memory; | Inspects memory pools across workers. |
| 93 | Check Active Spilled Memory | SELECT sum(spilled_bytes) FROM system.runtime.queries WHERE state = 'RUNNING'; | Measures spilled memory bytes. |
| 94 | Set Query Max Execution Time | SET SESSION query_max_execution_time = '1h'; | Caps query execution duration to 1 hour. |
| 95 | Set Hash Partitioning Strategy | SET SESSION hash_partition_user_supplier = true; | Activates hash partitioning for joins. |
| 96 | Set Task Concurrency | SET SESSION task_concurrency = 16; | Sets parallel execution threads per task. |
| 97 | Set Writer Count | SET SESSION task_writer_count = 8; | Sets parallel writer threads for CTAS/INSERT. |
| 98 | Show Catalogs Filtered | SHOW CATALOGS LIKE '%hive%'; | Lists catalogs matching filter expression. |
| 99 | Show Schemas Filtered | SHOW SCHEMAS FROM hive LIKE '%analytics%'; | Lists schemas matching filter expression. |
| 100 | Show Tables Filtered | SHOW TABLES FROM hive.analytics LIKE '%users%'; | Lists tables matching filter expression. |
| 101 | Check Active Nodes Count | SELECT count(*) FROM system.runtime.nodes; | Counts active coordinator and worker nodes. |
| 102 | Check Active Workers List | SELECT node_id, http_uri, node_version FROM system.runtime.nodes; | Lists worker node HTTP URIs and versions. |
| 103 | Check Active Queries Count | SELECT count(*) FROM system.runtime.queries WHERE state = 'RUNNING'; | Counts running queries across cluster. |
| 104 | Check Queued Queries Count | SELECT count(*) FROM system.runtime.queries WHERE state = 'QUEUED'; | Counts queued queries waiting for memory/slots. |
| 105 | Check Failed Queries Count | SELECT count(*) FROM system.runtime.queries WHERE state = 'FAILED'; | Counts failed queries in system history. |
| 106 | Check Finished Queries Count | SELECT count(*) FROM system.runtime.queries WHERE state = 'FINISHED'; | Counts completed queries in system history. |
| 107 | Check Query ID Details | SELECT query_id, user_source, state, queued_time_ms, analysis_time_ms, planning_time_ms, execution_time_ms FROM system.runtime.queries WHERE query_id = '20260729_110000_00001_abcde'; | Pulls exact timing metrics for query. |
| 108 | Check Query Memory Usage Bytes | SELECT query_id, peak_user_memory_bytes, peak_total_memory_bytes FROM system.runtime.queries WHERE query_id = '20260729_110000_00001_abcde'; | Inspects peak RAM consumed by query. |
| 109 | Check Query Processed Rows | SELECT query_id, processed_rows, processed_bytes FROM system.runtime.queries WHERE query_id = '20260729_110000_00001_abcde'; | Inspects total input rows and bytes scanned. |
| 110 | Check Query Task Count | SELECT query_id, total_tasks, completed_tasks FROM system.runtime.queries WHERE query_id = '20260729_110000_00001_abcde'; | Inspects parallel task execution counts. |
| 111 | Check Active Worker Memory Pools | SELECT node_id, pool, total_bytes, free_bytes, reserved_bytes FROM system.runtime.memory; | Inspects general vs reserved memory pools per worker. |
| 112 | Check Active Tasks List | SELECT task_id, node_id, state, splits FROM system.runtime.tasks WHERE state = 'RUNNING'; | Lists running parallel tasks across worker nodes. |
| 113 | Check Catalog List System Schema | SELECT catalog_name FROM system.metadata.catalogs; | Lists all registered connector catalogs. |
| 114 | Check Schema List System Schema | SELECT schema_name FROM system.jdbc.schemas WHERE catalog_name = 'hive'; | Lists schemas in catalog. |
| 115 | Check Table List System Schema | SELECT table_name FROM system.jdbc.tables WHERE table_cat = 'hive' AND table_schem = 'analytics'; | Lists tables in schema. |
| 116 | Check Column List System Schema | SELECT column_name, type_name FROM system.jdbc.columns WHERE table_cat = 'hive' AND table_schem = 'analytics' AND table_name = 'users'; | Lists columns and data types. |
| 117 | Check Materialized Views System Schema | SELECT * FROM system.metadata.materialized_views; | Lists all materialized views across catalogs. |
| 118 | Check Materialized View Properties | SELECT * FROM system.metadata.materialized_view_properties; | Lists supported properties for materialized views per connector. |
| 119 | Check Table Properties System Schema | SELECT * FROM system.metadata.table_properties; | Lists supported table properties per connector (format, partitioning, location). |
| 120 | Check Schema Properties System Schema | SELECT * FROM system.metadata.schema_properties; | Lists supported schema properties per connector. |
| 121 | Check Column Properties System Schema | SELECT * FROM system.metadata.column_properties; | Lists supported column properties per connector. |
| 122 | Check Session Properties System Schema | SELECT name, value, default_value, description FROM system.metadata.session_properties; | Lists all configurable session parameters. |
| 123 | Check Trino Version String SQL | SELECT VERSION(); | Outputs running Trino coordinator release version string. |
| 124 | Check Current User Account SQL | SELECT CURRENT_USER; | Outputs current execution user name. |
| 125 | Check Current Date SQL | SELECT CURRENT_DATE; | Outputs current server date. |
| 126 | Check Current Time SQL | SELECT CURRENT_TIME; | Outputs current server time. |
| 127 | Check Current Timestamp SQL | SELECT CURRENT_TIMESTAMP; | Outputs current server timestamp. |
| 128 | Check Connection Ping Query SQL | SELECT 1; | Simple connection ping test returning 1. |
| 129 | Check Coordinator Info HTTP API | curl http://localhost:8080/v1/info | Queries REST API endpoint for coordinator node status. |
| 130 | Check Coordinator State HTTP API | curl http://localhost:8080/v1/state | Queries REST API endpoint for coordinator cluster state. |
| 131 | Open Interactive CLI (Alt 130) | trino --server localhost:8080 --catalog postgres --schema public | Launches federated SQL query shell. |
| 132 | List Catalogs (Alt 131) | SHOW CATALOGS; | Outputs all configured connectors. |
| 133 | List Schemas (Alt 132) | SHOW SCHEMAS FROM hive; | Outputs schemas in catalog. |
| 134 | List Tables (Alt 133) | SHOW TABLES FROM hive.analytics; | Outputs tables in schema. |
| 135 | Describe Table Schema (Alt 134) | DESCRIBE hive.analytics.users; | Inspects table column data types. |
| 136 | Execute Query (Alt 135) | SELECT * FROM mysql.enterprise.users LIMIT 10; | Queries MySQL through federated engine. |
| 137 | Explain Query Execution (Alt 136) | EXPLAIN (TYPE DISTRIBUTED) SELECT * FROM hive.analytics.users; | Evaluates distributed query plan. |
| 138 | Show Running Queries (Alt 137) | SELECT query_id, state, query FROM system.runtime.queries WHERE state = 'RUNNING'; | Inspects active query executions. |
| 139 | Kill Running Query (Alt 138) | CALL system.runtime.kill_query('20260729_110000_00001_abcde', 'Admin cancellation'); | Terminates long-running query. |
| 140 | Create Schema (Alt 139) | CREATE SCHEMA hive.analytics; | Provisions new catalog schema. |
| 141 | Drop Schema (Alt 140) | DROP SCHEMA hive.analytics; | Removes catalog schema. |
| 142 | Create Table as Select (CTAS) (Alt 141) | CREATE TABLE hive.analytics.summary AS SELECT dept, count(*) FROM mysql.enterprise.users GROUP BY dept; | Provisions table via distributed query. |
| 143 | Drop Table (Alt 142) | DROP TABLE hive.analytics.summary; | Deletes federated table. |
| 144 | Show Active Nodes (Alt 143) | SELECT * FROM system.runtime.nodes; | Inspects coordinator and worker nodes. |
| 145 | Check Memory Pools (Alt 144) | SELECT * FROM system.runtime.memory; | Evaluates cluster memory usage. |
| 146 | Create View (Alt 145) | CREATE VIEW hive.analytics.v_users AS SELECT * FROM postgres.public.users; | Provisions federated view. |
| 147 | Drop View (Alt 146) | DROP VIEW hive.analytics.v_users; | Removes federated view. |
| 148 | Set Session Property (Alt 147) | SET SESSION query_max_run_time = '30m'; | Enforces query time limit. |
| 149 | Show Session Properties (Alt 148) | SHOW SESSION; | Inspects active session parameters. |
| 150 | Show Grants (Alt 149) | SHOW GRANTS ON TABLE hive.analytics.users; | Inspects security access permissions. |
| 151 | Grant Access Privilege (Alt 150) | GRANT SELECT ON TABLE hive.analytics.users TO ROLE analyst; | Assigns table access rights. |
| 152 | Revoke Access Privilege (Alt 151) | REVOKE SELECT ON TABLE hive.analytics.users FROM ROLE analyst; | Removes table access rights. |
| 153 | Create Role (Alt 152) | CREATE ROLE analyst; | Provisions security role. |
| 154 | Grant Role (Alt 153) | GRANT ROLE analyst TO USER jlawrence; | Assigns role to user profile. |
| 155 | Query Information Schema (Alt 154) | SELECT * FROM hive.information_schema.tables; | Inspects catalog metadata schema. |
| 156 | Check Task Execution Stats (Alt 155) | SELECT * FROM system.runtime.tasks WHERE state = 'RUNNING'; | Inspects distributed task execution nodes. |
| 157 | Invalidate Metadata Cache (Alt 156) | CALL hive.system.flush_metadata_cache(); | Refreshes connector metadata cache. |
| 158 | Prepare Statement (Alt 157) | PREPARE stmt FROM SELECT * FROM users WHERE id = ?; | Prepares parameterized query. |
| 159 | Execute Prepared Statement (Alt 158) | EXECUTE stmt USING 10; | Runs prepared SQL statement. |
| 160 | Exit CLI (Alt 159) | QUIT; | Closes interactive Trino shell. |
| 161 | Explain IO Query Plan (Alt 160) | EXPLAIN (TYPE IO) SELECT * FROM hive.analytics.users; | Outputs estimated input bytes and read rows. |
| 162 | Explain Validate Query (Alt 161) | EXPLAIN (TYPE VALIDATE) SELECT * FROM hive.analytics.users; | Validates query syntax and schema without execution. |
| 163 | Explain Logical Query Plan (Alt 162) | EXPLAIN (TYPE LOGICAL) SELECT * FROM hive.analytics.users; | Outputs logical relational operator tree. |
| 164 | Show Functions (Alt 163) | SHOW FUNCTIONS; | Lists all available scalar, aggregate, and window functions. |
| 165 | Show Create Table DDL (Alt 164) | SHOW CREATE TABLE hive.analytics.users; | Outputs exact DDL syntax used to build table. |
| 166 | Show Create Schema DDL (Alt 165) | SHOW CREATE SCHEMA hive.analytics; | Outputs exact DDL syntax used to build schema. |
| 167 | Show Create View DDL (Alt 166) | SHOW CREATE VIEW hive.analytics.v_users; | Outputs exact DDL syntax used to build view. |
| 168 | Show Columns (Alt 167) | SHOW COLUMNS FROM hive.analytics.users; | Outputs detailed column metadata and comments. |
| 169 | Show Stats for Table (Alt 168) | SHOW STATS FOR hive.analytics.users; | Pulls row counts, null fractions, and distinct values. |
| 170 | Analyze Table Statistics (Alt 169) | ANALYZE hive.analytics.users; | Gathers table statistics for cost-based optimizer. |
| 171 | Create Empty Table (Alt 170) | CREATE TABLE hive.analytics.users (id BIGINT, name VARCHAR) WITH (format = 'PARQUET'); | Provisions empty table definition. |
| 172 | Insert Into Table (Alt 171) | INSERT INTO hive.analytics.users VALUES (1, 'Alice'); | Appends records into table. |
| 173 | Delete Rows from Table (Alt 172) | DELETE FROM hive.analytics.users WHERE id = 1; | Removes rows matching condition. |
| 174 | Update Table Rows (Alt 173) | UPDATE hive.analytics.users SET name = 'Alicia' WHERE id = 1; | Modifies table row values. |
| 175 | Merge Into Table (Alt 174) | MERGE INTO hive.analytics.target t USING hive.analytics.source s ON t.id = s.id WHEN MATCHED THEN UPDATE SET t.name = s.name WHEN NOT MATCHED THEN INSERT (id, name) VALUES (s.id, s.name); | Executes MERGE upsert operation. |
| 176 | Alter Table Rename (Alt 175) | ALTER TABLE hive.analytics.users RENAME TO hive.analytics.app_users; | Renames table relation in catalog. |
| 177 | Alter Table Add Column (Alt 176) | ALTER TABLE hive.analytics.users ADD COLUMN age INTEGER; | Appends column to table schema. |
| 178 | Alter Table Drop Column (Alt 177) | ALTER TABLE hive.analytics.users DROP COLUMN age; | Removes column from table schema. |
| 179 | Alter Table Rename Column (Alt 178) | ALTER TABLE hive.analytics.users RENAME COLUMN name TO full_name; | Renames column in table schema. |
| 180 | Set Table Comment (Alt 179) | COMMENT ON TABLE hive.analytics.users IS 'Production user records'; | Updates table comment description. |
| 181 | Set Column Comment (Alt 180) | COMMENT ON COLUMN hive.analytics.users.id IS 'Primary key identifier'; | Updates column comment description. |
| 182 | Create Schema with Location (Alt 181) | CREATE SCHEMA iceberg.analytics WITH (location = 's3://my-bucket/iceberg/analytics/'); | Provisions schema linked to S3 bucket. |
| 183 | Set Catalog Session Property (Alt 182) | SET SESSION hive.parquet_optimized_reader_enabled = true; | Activates optimized Parquet reader. |
| 184 | Reset Session Property (Alt 183) | RESET SESSION query_max_run_time; | Restores session parameter to default. |
| 185 | Set Join Distribution (Alt 184) | SET SESSION join_distribution_type = 'BROADCAST'; | Forces broadcast hash join strategy. |
| 186 | Set Spilling Enabled (Alt 185) | SET SESSION spill_enabled = true; | Allows disk spilling for large hash joins. |
| 187 | Set Memory Revocable (Alt 186) | SET SESSION query_max_memory_per_node = '8GB'; | Caps per-node memory allocation. |
| 188 | Check Query Execution History (Alt 187) | SELECT * FROM system.runtime.queries ORDER BY created DESC LIMIT 20; | Inspects historical query execution log. |
| 189 | Check Query Stage Stats (Alt 188) | SELECT * FROM system.runtime.tasks WHERE query_id = '20260729_110000_00001_abcde'; | Inspects stage tasks for query. |
| 190 | Check Active Worker Memory (Alt 189) | SELECT node_id, memory_type, bytes FROM system.runtime.memory; | Inspects memory distribution per worker node. |
| 191 | Check Active Cluster CPU (Alt 190) | SELECT node_id, cpu_user, cpu_system FROM system.runtime.nodes; | Inspects CPU load across worker nodes. |
| 192 | Check Catalog Connectors (Alt 191) | SELECT * FROM system.metadata.catalogs; | Lists connector catalogs and properties. |
| 193 | Check Materialized Views (Alt 192) | SELECT * FROM system.metadata.materialized_views; | Lists materialized views across catalogs. |
| 194 | Refresh Materialized View (Alt 193) | REFRESH MATERIALIZED VIEW hive.analytics.mv_users; | Triggers refresh of materialized view data. |
| 195 | Drop Materialized View (Alt 194) | DROP MATERIALIZED VIEW hive.analytics.mv_users; | Deletes materialized view. |
| 196 | Create Materialized View (Alt 195) | CREATE MATERIALIZED VIEW hive.analytics.mv_users AS SELECT dept, count(*) FROM hive.analytics.users GROUP BY dept; | Provisions pre-computed materialized view. |
| 197 | Check System Transactions (Alt 196) | SELECT * FROM system.runtime.transactions; | Inspects active cluster transactions. |
| 198 | Revoke Role (Alt 197) | REVOKE ROLE analyst FROM USER jlawrence; | Revokes security role from user. |
| 199 | Drop Role (Alt 198) | DROP ROLE analyst; | Deletes security role. |
| 200 | Show Roles (Alt 199) | SHOW ROLES; | Lists all security roles in cluster. |
Apache Hive OLAP
Technical Architecture & Overview
Apache Hive is a data warehouse software system built on top of Apache Hadoop for providing data summarization, ad-hoc querying, and analysis of large datasets stored in HDFS or S3. It uses HiveQL (SQL dialect) translated into execution plans on Apache Tez, MapReduce, or Spark, backed by a central Metastore RDBMS.
Primary Use Cases: Batch ETL processing, enterprise data lake warehousing, historical petabyte-scale reporting, and centralized metadata cataloging via Hive Metastore.
Core Components: HiveServer2 (HS2 JDBC/ODBC endpoint), Hive Metastore (HMS RDBMS metadata store), Beeline CLI, Execution Engines (Tez / MapReduce / Spark), and HDFS/S3 storage.
Exhaustive 200-command administrative, diagnostic, and operational matrix for Apache Hive.
| # | Operation / Action | Beeline CLI / HiveQL Syntax | Description |
|---|---|---|---|
| 1 | Connect via Beeline CLI | beeline -u jdbc:hive2://localhost:10000/default -n hive | Opens HiveQL interactive shell. |
| 2 | List Databases | SHOW DATABASES; | Outputs all Hive metastore databases. |
| 3 | Create Database | CREATE DATABASE IF NOT EXISTS enterprise_db; | Provisions new metastore database. |
| 4 | Drop Database | DROP DATABASE IF EXISTS enterprise_db CASCADE; | Deletes database and tables. |
| 5 | List Tables | SHOW TABLES FROM enterprise_db; | Outputs tables inside database. |
| 6 | Create Managed Table | CREATE TABLE enterprise_db.users (id INT, name STRING) STORED AS PARQUET; | Provisions managed Parquet table. |
| 7 | Create External Table | CREATE EXTERNAL TABLE enterprise_db.ext_users (id INT, name STRING) LOCATION '/apps/hive/warehouse/ext'; | Provisions external table. |
| 8 | Drop Table | DROP TABLE enterprise_db.users; | Deletes table definition. |
| 9 | Describe Table Schema | DESCRIBE FORMATTED enterprise_db.users; | Inspects detailed table storage properties. |
| 10 | Load Data from HDFS | LOAD DATA INPATH '/tmp/users.csv' INTO TABLE enterprise_db.users; | Ingests file from HDFS into table. |
| 11 | Repair Table (Recover Partitions) | MSCK REPAIR TABLE enterprise_db.users; | Discovers new HDFS partition folders. |
| 12 | Create Partitioned Table | CREATE TABLE enterprise_db.logs (msg STRING) PARTITIONED BY (dt STRING) STORED AS ORC; | Provisions partitioned ORC table. |
| 13 | Add Partition | ALTER TABLE enterprise_db.logs ADD PARTITION (dt='2026-07-29'); | Manually provisions table partition. |
| 14 | Drop Partition | ALTER TABLE enterprise_db.logs DROP PARTITION (dt='2026-01-01'); | Removes table partition data. |
| 15 | Analyze Table Stats | ANALYZE TABLE enterprise_db.users COMPUTE STATISTICS; | Gathers table cost statistics. |
| 16 | Analyze Table Partitions | ANALYZE TABLE enterprise_db.logs PARTITION(dt) COMPUTE STATISTICS; | Gathers partition statistics. |
| 17 | Explain Query Execution | EXPLAIN EXTENDED SELECT * FROM enterprise_db.users; | Evaluates MapReduce/Tez execution plan. |
| 18 | Create View | CREATE VIEW enterprise_db.v_users AS SELECT * FROM enterprise_db.users WHERE id > 0; | Provisions virtual query view. |
| 19 | Drop View | DROP VIEW enterprise_db.v_users; | Removes virtual view. |
| 20 | Create Role | CREATE ROLE data_analyst; | Provisions security role. |
| 21 | Grant Role Privilege | GRANT SELECT ON TABLE enterprise_db.users TO ROLE data_analyst; | Assigns table access rights. |
| 22 | Show Grants | SHOW GRANT ROLE data_analyst ON TABLE enterprise_db.users; | Inspects security permissions. |
| 23 | Set Execution Engine Tez | SET hive.execution.engine=tez; | Configures Tez high-speed execution engine. |
| 24 | Enable Cost-Based Optimizer | SET hive.cbo.enable=true; | Activates CBO query planner. |
| 25 | Compact Table (Major) | ALTER TABLE enterprise_db.users COMPACT 'MAJOR'; | Compacts ACID delta files. |
| 26 | Show Compactions | SHOW COMPACTIONS; | Inspects background compaction status. |
| 27 | Show Transactions | SHOW TRANSACTIONS; | Inspects active ACID transactions. |
| 28 | Abort Transaction | ABORT TRANSACTION 12345; | Stops stuck ACID transaction. |
| 29 | Query Information Schema | SELECT * FROM information_schema.tables WHERE table_schema = 'enterprise_db'; | Inspects metastore metadata catalog. |
| 30 | Exit Beeline CLI | !quit | Closes interactive Beeline session. |
| 31 | Create Transactional ACID Table | CREATE TABLE enterprise_db.acid_users (id INT, name STRING) STORED AS ORC TBLPROPERTIES ('transactional'='true'); | Provisions ACID transactional ORC table. |
| 32 | Compact Table (Minor) | ALTER TABLE enterprise_db.users COMPACT 'MINOR'; | Compacts small delta files. |
| 33 | Compact Partition (Major) | ALTER TABLE enterprise_db.logs PARTITION (dt='2026-07-29') COMPACT 'MAJOR'; | Compacts ACID delta files for partition. |
| 34 | Set Dynamic Partitioning Mode | SET hive.exec.dynamic.partition.mode=nonstrict; | Enables dynamic partitioning without static key. |
| 35 | Set Dynamic Partitioning True | SET hive.exec.dynamic.partition=true; | Activates dynamic partitioning execution. |
| 36 | Set Max Dynamic Partitions | SET hive.exec.max.dynamic.partitions=10000; | Increases max dynamic partition creation limit. |
| 37 | Set Max Dynamic Partitions Per Node | SET hive.exec.max.dynamic.partitions.pernode=1000; | Increases max dynamic partitions per mapper. |
| 38 | Create Bucketed Table | CREATE TABLE enterprise_db.bucketed_users (id INT, name STRING) CLUSTERED BY (id) INTO 16 BUCKETS STORED AS ORC; | Provisions bucketed table. |
| 39 | Create Bucketed Sorted Table | CREATE TABLE enterprise_db.sorted_users (id INT, name STRING) CLUSTERED BY (id) SORTED BY (id) INTO 16 BUCKETS STORED AS ORC; | Provisions bucketed and pre-sorted table. |
| 40 | Set Enforce Bucketing | SET hive.enforce.bucketing=true; | Enforces correct bucketing distribution on insert. |
| 41 | Set Enforce Sorting | SET hive.enforce.sorting=true; | Enforces correct row sorting on insert. |
| 42 | Insert Overwrite Table | INSERT OVERWRITE TABLE enterprise_db.users SELECT * FROM enterprise_db.ext_users; | Replaces table data rows. |
| 43 | Insert Overwrite Partition | INSERT OVERWRITE TABLE enterprise_db.logs PARTITION (dt='2026-07-29') SELECT msg FROM staging; | Replaces specific partition data. |
| 44 | Alter Table Rename | ALTER TABLE enterprise_db.users RENAME TO enterprise_db.app_users; | Renames table in metastore. |
| 45 | Alter Table Add Columns | ALTER TABLE enterprise_db.users ADD COLUMNS (age INT, email STRING); | Appends new columns to table schema. |
| 46 | Alter Table Replace Columns | ALTER TABLE enterprise_db.users REPLACE COLUMNS (id INT, full_name STRING); | Redefines table schema columns. |
| 47 | Alter Table Change Column | ALTER TABLE enterprise_db.users CHANGE COLUMN name full_name STRING COMMENT 'Full user name'; | Renames and updates column comment. |
| 48 | Alter Table Set Properties | ALTER TABLE enterprise_db.users SET TBLPROPERTIES ('comment'='Updated user table'); | Updates metastore table properties. |
| 49 | Alter Table Set SerDe | ALTER TABLE enterprise_db.users SET SERDE 'org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveSerDe'; | Updates table SerDe class. |
| 50 | Alter Table Set Location | ALTER TABLE enterprise_db.users SET LOCATION '/apps/hive/warehouse/new_loc'; | Points table to new HDFS path. |
| 51 | Show Partitions | SHOW PARTITIONS enterprise_db.logs; | Lists all partition values for table. |
| 52 | Show Create Table DDL | SHOW CREATE TABLE enterprise_db.users; | Outputs exact DDL syntax used to build table. |
| 53 | Show Functions | SHOW FUNCTIONS; | Lists all built-in and custom UDF functions. |
| 54 | Describe Function | DESCRIBE FUNCTION EXTENDED upper; | Inspects parameters and usage of function. |
| 55 | Create Temporary Function | CREATE TEMPORARY FUNCTION my_udf AS 'com.org.MyUDF'; | Provisions session-scoped custom UDF. |
| 56 | Drop Temporary Function | DROP TEMPORARY FUNCTION IF EXISTS my_udf; | Deletes session-scoped UDF. |
| 57 | Create Permanent Function | CREATE FUNCTION enterprise_db.my_udf AS 'com.org.MyUDF' USING JAR 'hdfs:///udfs/my_udf.jar'; | Provisions metastore persistent UDF. |
| 58 | Drop Permanent Function | DROP FUNCTION enterprise_db.my_udf; | Deletes metastore persistent UDF. |
| 59 | Create Index | CREATE INDEX idx_user_id ON TABLE enterprise_db.users (id) AS 'COMPACT' WITH DEFERRED REBUILD; | Provisions legacy Hive index. |
| 60 | Alter Index Rebuild | ALTER INDEX idx_user_id ON enterprise_db.users REBUILD; | Builds legacy Hive index data. |
| 61 | Drop Index | DROP INDEX IF EXISTS idx_user_id ON enterprise_db.users; | Deletes legacy Hive index. |
| 62 | Show Indexes | SHOW INDEXES ON enterprise_db.users; | Lists all legacy indexes on table. |
| 63 | Create Materialized View | CREATE MATERIALIZED VIEW enterprise_db.mv_summary STORED AS ORC AS SELECT dept, COUNT(*) FROM enterprise_db.users GROUP BY dept; | Provisions auto-rewritten materialized view. |
| 64 | Refresh Materialized View | ALTER MATERIALIZED VIEW enterprise_db.mv_summary REBUILD; | Rebuilds materialized view dataset. |
| 65 | Drop Materialized View | DROP MATERIALIZED VIEW enterprise_db.mv_summary; | Deletes materialized view. |
| 66 | Show Materialized Views | SHOW MATERIALIZED VIEWS IN enterprise_db; | Lists all materialized views in database. |
| 67 | Grant Role To User | GRANT ROLE data_analyst TO USER jlawrence; | Assigns role to user account. |
| 68 | Revoke Role From User | REVOKE ROLE data_analyst FROM USER jlawrence; | Revokes role from user account. |
| 69 | Drop Role | DROP ROLE data_analyst; | Deletes security role. |
| 70 | Show Roles | SHOW ROLES; | Lists all security roles in metastore. |
| 71 | Show Current Roles | SHOW CURRENT ROLES; | Lists active roles in current Beeline session. |
| 72 | Set Role | SET ROLE data_analyst; | Activates role in current Beeline session. |
| 73 | Set Vectorization Enabled | SET hive.vectorized.execution.enabled=true; | Activates vectorized query execution engine. |
| 74 | Set Vectorized Reduce Enabled | SET hive.vectorized.execution.reduce.enabled=true; | Activates vectorized reduce phase execution. |
| 75 | Set Fetch Task Conversion | SET hive.fetch.task.conversion=more; | Executes simple queries directly without Tez jobs. |
| 76 | Set Auto Convert Join | SET hive.auto.convert.join=true; | Automatically converts joins to MapJoins in memory. |
| 77 | Set MapJoin Memory Size | SET hive.auto.convert.join.noconditionaltask.size=1000000000; | Increases max RAM size for MapJoin conversion. |
| 78 | Set LLAP Execution | SET hive.execution.mode=llap; | Routes queries to LLAP daemon pool for sub-second execution. |
| 79 | Check LLAP Daemon Status | hive --service llapstatus | Inspects active LLAP worker daemon status. |
| 80 | Set Merge Small Files Mappers | SET hive.merge.mapfiles=true; | Merges small output files at end of Map-only job. |
| 81 | Set Merge Small Files Reducers | SET hive.merge.mapredfiles=true; | Merges small output files at end of MapReduce job. |
| 82 | Set Target File Size | SET hive.merge.size.per.task=256000000; | Sets target merged file size to 256MB. |
| 83 | Set Small File Threshold | SET hive.merge.smallfiles.avgsize=16000000; | Triggers file merging if average size < 16MB. |
| 84 | Check Metastore Database Health | hive --service metastore | Boots/checks Hive Metastore service daemon. |
| 85 | Check HiveServer2 Health | hive --service hiveserver2 | Boots/checks HiveServer2 service daemon. |
| 86 | Export Table Metadata | EXPORT TABLE enterprise_db.users TO '/tmp/export_users'; | Exports table data and metadata to HDFS path. |
| 87 | Import Table Metadata | IMPORT TABLE enterprise_db.imp_users FROM '/tmp/export_users'; | Imports table data and metadata from HDFS path. |
| 88 | Show Lock Details | SHOW LOCKS enterprise_db.users; | Inspects active locks on table. |
| 89 | Unlock Table | UNLOCK TABLE enterprise_db.users; | Force-releases lock on table. |
| 90 | Check Beeline Connection Commands | !connect jdbc:hive2://localhost:10000/default hive pass | Connects to alternative HiveServer2 endpoint. |
| 91 | Beeline Reconnect | !reconnect | Reconnects active Beeline session. |
| 92 | Beeline Save History | !history | Outputs recent Beeline command history. |
| 93 | Beeline Set AutoCommit | !autocommit off | Disables autocommit mode in Beeline. |
| 94 | Set Query Timeout | SET hive.transaction.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager; | Enforces ACID transaction manager. |
| 95 | Set Strict Partitioning | SET hive.mapred.mode=strict; | Blocks queries without partition clauses on partitioned tables. |
| 96 | Check Metastore Schema Version | SELECT * FROM VERSION; | Queries metastore RDBMS for schema version. |
| 97 | Check Hive Server Version | SELECT reflect('java.lang.System', 'getProperty', 'java.version'); | Outputs JVM runtime version in HiveServer2. |
| 98 | Check Metastore Tables List | SHOW TABLES LIKE 'app_*'; | Lists tables matching pattern. |
| 99 | Clear Beeline Screen | !clear | Clears command-line terminal screen. |
| 100 | Check Hive Metastore Service Status | hive --service metastore -v | Outputs verbose diagnostic logs for metastore. |
| 101 | Check Databases Count | SELECT count(*) FROM information_schema.schemata; | Counts total databases in metastore. |
| 102 | Check Tables Count In Database | SELECT count(*) FROM information_schema.tables WHERE table_schema = 'enterprise_db'; | Counts total tables in database. |
| 103 | Check Views Count In Database | SELECT count(*) FROM information_schema.views WHERE table_schema = 'enterprise_db'; | Counts total views in database. |
| 104 | Check Columns List In Table | SELECT column_name, data_type FROM information_schema.columns WHERE table_schema = 'enterprise_db' AND table_name = 'users'; | Lists columns and types. |
| 105 | Check Table Partitions Count | SHOW PARTITIONS enterprise_db.logs; | Lists all partition values for table. |
| 106 | Check Table Create DDL | SHOW CREATE TABLE enterprise_db.users; | Outputs exact DDL syntax used to build table. |
| 107 | Check Database Create DDL | SHOW CREATE DATABASE enterprise_db; | Outputs exact DDL syntax used to build database. |
| 108 | Check Functions Count | SHOW FUNCTIONS; | Lists all built-in and custom UDF functions. |
| 109 | Check Function Usage Help | DESCRIBE FUNCTION EXTENDED upper; | Inspects parameters and usage of function. |
| 110 | Check Active Locks On Table | SHOW LOCKS enterprise_db.users; | Inspects active locks held on table. |
| 111 | Check Active Compactions Queue | SHOW COMPACTIONS; | Monitors background ACID file compaction queue. |
| 112 | Check Active Transactions List | SHOW TRANSACTIONS; | Monitors active ACID transactions. |
| 113 | Check Active Roles List | SHOW ROLES; | Lists all security roles in metastore. |
| 114 | Check Current User Roles | SHOW CURRENT ROLES; | Lists active roles in current Beeline session. |
| 115 | Check Table Privileges On User | SHOW GRANT USER jlawrence ON TABLE enterprise_db.users; | Lists table privileges assigned to user. |
| 116 | Check Table Privileges On Role | SHOW GRANT ROLE data_analyst ON TABLE enterprise_db.users; | Lists table privileges assigned to role. |
| 117 | Set Execution Engine Tez | SET hive.execution.engine=tez; | Enforces Apache Tez execution engine. |
| 118 | Set Execution Engine MapReduce | SET hive.execution.engine=mr; | Enforces legacy MapReduce execution engine. |
| 119 | Set Vectorization Enabled | SET hive.vectorized.execution.enabled=true; | Activates vectorized query execution engine. |
| 120 | Set Dynamic Partition Mode Nonstrict | SET hive.exec.dynamic.partition.mode=nonstrict; | Enables dynamic partitioning without static key. |
| 121 | Set Dynamic Partition Enabled | SET hive.exec.dynamic.partition=true; | Activates dynamic partitioning execution. |
| 122 | Set CBO Enabled | SET hive.cbo.enable=true; | Activates Cost-Based Optimizer. |
| 123 | Set Auto Convert Join | SET hive.auto.convert.join=true; | Automatically converts joins to MapJoins in memory. |
| 124 | Set Fetch Task Conversion | SET hive.fetch.task.conversion=more; | Executes simple queries directly without launching Tez jobs. |
| 125 | Check Hive Version SQL | SELECT reflect('java.lang.System', 'getProperty', 'java.version'); | Outputs JVM runtime version in HiveServer2. |
| 126 | Check Ping Connection Query | SELECT 1; | Simple connection ping query returning 1. |
| 127 | Beeline Reconnect | !reconnect | Reconnects active Beeline session. |
| 128 | Beeline History | !history | Outputs recent Beeline command history. |
| 129 | Beeline Clear Screen | !clear | Clears command-line terminal screen. |
| 130 | Beeline Quit | !quit | Exits Beeline command-line interface. |
| 131 | Connect via Beeline CLI (Alt 130) | beeline -u jdbc:hive2://localhost:10000/default -n hive | Opens HiveQL interactive shell. |
| 132 | List Databases (Alt 131) | SHOW DATABASES; | Outputs all Hive metastore databases. |
| 133 | Create Database (Alt 132) | CREATE DATABASE IF NOT EXISTS enterprise_db; | Provisions new metastore database. |
| 134 | Drop Database (Alt 133) | DROP DATABASE IF EXISTS enterprise_db CASCADE; | Deletes database and tables. |
| 135 | List Tables (Alt 134) | SHOW TABLES FROM enterprise_db; | Outputs tables inside database. |
| 136 | Create Managed Table (Alt 135) | CREATE TABLE enterprise_db.users (id INT, name STRING) STORED AS PARQUET; | Provisions managed Parquet table. |
| 137 | Create External Table (Alt 136) | CREATE EXTERNAL TABLE enterprise_db.ext_users (id INT, name STRING) LOCATION '/apps/hive/warehouse/ext'; | Provisions external table. |
| 138 | Drop Table (Alt 137) | DROP TABLE enterprise_db.users; | Deletes table definition. |
| 139 | Describe Table Schema (Alt 138) | DESCRIBE FORMATTED enterprise_db.users; | Inspects detailed table storage properties. |
| 140 | Load Data from HDFS (Alt 139) | LOAD DATA INPATH '/tmp/users.csv' INTO TABLE enterprise_db.users; | Ingests file from HDFS into table. |
| 141 | Repair Table (Recover Partitions) (Alt 140) | MSCK REPAIR TABLE enterprise_db.users; | Discovers new HDFS partition folders. |
| 142 | Create Partitioned Table (Alt 141) | CREATE TABLE enterprise_db.logs (msg STRING) PARTITIONED BY (dt STRING) STORED AS ORC; | Provisions partitioned ORC table. |
| 143 | Add Partition (Alt 142) | ALTER TABLE enterprise_db.logs ADD PARTITION (dt='2026-07-29'); | Manually provisions table partition. |
| 144 | Drop Partition (Alt 143) | ALTER TABLE enterprise_db.logs DROP PARTITION (dt='2026-01-01'); | Removes table partition data. |
| 145 | Analyze Table Stats (Alt 144) | ANALYZE TABLE enterprise_db.users COMPUTE STATISTICS; | Gathers table cost statistics. |
| 146 | Analyze Table Partitions (Alt 145) | ANALYZE TABLE enterprise_db.logs PARTITION(dt) COMPUTE STATISTICS; | Gathers partition statistics. |
| 147 | Explain Query Execution (Alt 146) | EXPLAIN EXTENDED SELECT * FROM enterprise_db.users; | Evaluates MapReduce/Tez execution plan. |
| 148 | Create View (Alt 147) | CREATE VIEW enterprise_db.v_users AS SELECT * FROM enterprise_db.users WHERE id > 0; | Provisions virtual query view. |
| 149 | Drop View (Alt 148) | DROP VIEW enterprise_db.v_users; | Removes virtual view. |
| 150 | Create Role (Alt 149) | CREATE ROLE data_analyst; | Provisions security role. |
| 151 | Grant Role Privilege (Alt 150) | GRANT SELECT ON TABLE enterprise_db.users TO ROLE data_analyst; | Assigns table access rights. |
| 152 | Show Grants (Alt 151) | SHOW GRANT ROLE data_analyst ON TABLE enterprise_db.users; | Inspects security permissions. |
| 153 | Set Execution Engine Tez (Alt 152) | SET hive.execution.engine=tez; | Configures Tez high-speed execution engine. |
| 154 | Enable Cost-Based Optimizer (Alt 153) | SET hive.cbo.enable=true; | Activates CBO query planner. |
| 155 | Compact Table (Major) (Alt 154) | ALTER TABLE enterprise_db.users COMPACT 'MAJOR'; | Compacts ACID delta files. |
| 156 | Show Compactions (Alt 155) | SHOW COMPACTIONS; | Inspects background compaction status. |
| 157 | Show Transactions (Alt 156) | SHOW TRANSACTIONS; | Inspects active ACID transactions. |
| 158 | Abort Transaction (Alt 157) | ABORT TRANSACTION 12345; | Stops stuck ACID transaction. |
| 159 | Query Information Schema (Alt 158) | SELECT * FROM information_schema.tables WHERE table_schema = 'enterprise_db'; | Inspects metastore metadata catalog. |
| 160 | Exit Beeline CLI (Alt 159) | !quit | Closes interactive Beeline session. |
| 161 | Create Transactional ACID Table (Alt 160) | CREATE TABLE enterprise_db.acid_users (id INT, name STRING) STORED AS ORC TBLPROPERTIES ('transactional'='true'); | Provisions ACID transactional ORC table. |
| 162 | Compact Table (Minor) (Alt 161) | ALTER TABLE enterprise_db.users COMPACT 'MINOR'; | Compacts small delta files. |
| 163 | Compact Partition (Major) (Alt 162) | ALTER TABLE enterprise_db.logs PARTITION (dt='2026-07-29') COMPACT 'MAJOR'; | Compacts ACID delta files for partition. |
| 164 | Set Dynamic Partitioning Mode (Alt 163) | SET hive.exec.dynamic.partition.mode=nonstrict; | Enables dynamic partitioning without static key. |
| 165 | Set Dynamic Partitioning True (Alt 164) | SET hive.exec.dynamic.partition=true; | Activates dynamic partitioning execution. |
| 166 | Set Max Dynamic Partitions (Alt 165) | SET hive.exec.max.dynamic.partitions=10000; | Increases max dynamic partition creation limit. |
| 167 | Set Max Dynamic Partitions Per Node (Alt 166) | SET hive.exec.max.dynamic.partitions.pernode=1000; | Increases max dynamic partitions per mapper. |
| 168 | Create Bucketed Table (Alt 167) | CREATE TABLE enterprise_db.bucketed_users (id INT, name STRING) CLUSTERED BY (id) INTO 16 BUCKETS STORED AS ORC; | Provisions bucketed table. |
| 169 | Create Bucketed Sorted Table (Alt 168) | CREATE TABLE enterprise_db.sorted_users (id INT, name STRING) CLUSTERED BY (id) SORTED BY (id) INTO 16 BUCKETS STORED AS ORC; | Provisions bucketed and pre-sorted table. |
| 170 | Set Enforce Bucketing (Alt 169) | SET hive.enforce.bucketing=true; | Enforces correct bucketing distribution on insert. |
| 171 | Set Enforce Sorting (Alt 170) | SET hive.enforce.sorting=true; | Enforces correct row sorting on insert. |
| 172 | Insert Overwrite Table (Alt 171) | INSERT OVERWRITE TABLE enterprise_db.users SELECT * FROM enterprise_db.ext_users; | Replaces table data rows. |
| 173 | Insert Overwrite Partition (Alt 172) | INSERT OVERWRITE TABLE enterprise_db.logs PARTITION (dt='2026-07-29') SELECT msg FROM staging; | Replaces specific partition data. |
| 174 | Alter Table Rename (Alt 173) | ALTER TABLE enterprise_db.users RENAME TO enterprise_db.app_users; | Renames table in metastore. |
| 175 | Alter Table Add Columns (Alt 174) | ALTER TABLE enterprise_db.users ADD COLUMNS (age INT, email STRING); | Appends new columns to table schema. |
| 176 | Alter Table Replace Columns (Alt 175) | ALTER TABLE enterprise_db.users REPLACE COLUMNS (id INT, full_name STRING); | Redefines table schema columns. |
| 177 | Alter Table Change Column (Alt 176) | ALTER TABLE enterprise_db.users CHANGE COLUMN name full_name STRING COMMENT 'Full user name'; | Renames and updates column comment. |
| 178 | Alter Table Set Properties (Alt 177) | ALTER TABLE enterprise_db.users SET TBLPROPERTIES ('comment'='Updated user table'); | Updates metastore table properties. |
| 179 | Alter Table Set SerDe (Alt 178) | ALTER TABLE enterprise_db.users SET SERDE 'org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveSerDe'; | Updates table SerDe class. |
| 180 | Alter Table Set Location (Alt 179) | ALTER TABLE enterprise_db.users SET LOCATION '/apps/hive/warehouse/new_loc'; | Points table to new HDFS path. |
| 181 | Show Partitions (Alt 180) | SHOW PARTITIONS enterprise_db.logs; | Lists all partition values for table. |
| 182 | Show Create Table DDL (Alt 181) | SHOW CREATE TABLE enterprise_db.users; | Outputs exact DDL syntax used to build table. |
| 183 | Show Functions (Alt 182) | SHOW FUNCTIONS; | Lists all built-in and custom UDF functions. |
| 184 | Describe Function (Alt 183) | DESCRIBE FUNCTION EXTENDED upper; | Inspects parameters and usage of function. |
| 185 | Create Temporary Function (Alt 184) | CREATE TEMPORARY FUNCTION my_udf AS 'com.org.MyUDF'; | Provisions session-scoped custom UDF. |
| 186 | Drop Temporary Function (Alt 185) | DROP TEMPORARY FUNCTION IF EXISTS my_udf; | Deletes session-scoped UDF. |
| 187 | Create Permanent Function (Alt 186) | CREATE FUNCTION enterprise_db.my_udf AS 'com.org.MyUDF' USING JAR 'hdfs:///udfs/my_udf.jar'; | Provisions metastore persistent UDF. |
| 188 | Drop Permanent Function (Alt 187) | DROP FUNCTION enterprise_db.my_udf; | Deletes metastore persistent UDF. |
| 189 | Create Index (Alt 188) | CREATE INDEX idx_user_id ON TABLE enterprise_db.users (id) AS 'COMPACT' WITH DEFERRED REBUILD; | Provisions legacy Hive index. |
| 190 | Alter Index Rebuild (Alt 189) | ALTER INDEX idx_user_id ON enterprise_db.users REBUILD; | Builds legacy Hive index data. |
| 191 | Drop Index (Alt 190) | DROP INDEX IF EXISTS idx_user_id ON enterprise_db.users; | Deletes legacy Hive index. |
| 192 | Show Indexes (Alt 191) | SHOW INDEXES ON enterprise_db.users; | Lists all legacy indexes on table. |
| 193 | Create Materialized View (Alt 192) | CREATE MATERIALIZED VIEW enterprise_db.mv_summary STORED AS ORC AS SELECT dept, COUNT(*) FROM enterprise_db.users GROUP BY dept; | Provisions auto-rewritten materialized view. |
| 194 | Refresh Materialized View (Alt 193) | ALTER MATERIALIZED VIEW enterprise_db.mv_summary REBUILD; | Rebuilds materialized view dataset. |
| 195 | Drop Materialized View (Alt 194) | DROP MATERIALIZED VIEW enterprise_db.mv_summary; | Deletes materialized view. |
| 196 | Show Materialized Views (Alt 195) | SHOW MATERIALIZED VIEWS IN enterprise_db; | Lists all materialized views in database. |
| 197 | Grant Role To User (Alt 196) | GRANT ROLE data_analyst TO USER jlawrence; | Assigns role to user account. |
| 198 | Revoke Role From User (Alt 197) | REVOKE ROLE data_analyst FROM USER jlawrence; | Revokes role from user account. |
| 199 | Drop Role (Alt 198) | DROP ROLE data_analyst; | Deletes security role. |
| 200 | Show Roles (Alt 199) | SHOW ROLES; | Lists all security roles in metastore. |
Apache Iceberg OLAP
Technical Architecture & Overview
Apache Iceberg is an open table format for huge analytic datasets. It provides full ACID transaction guarantees, schema evolution without side effects, partition evolution without rewriting tables, time travel querying, and fast metadata-driven filtering across compute engines (Spark, Trino, Flink, DuckDB, Snowflake).
Primary Use Cases: Open lakehouse data architectures, large-scale S3/ADLS/GCS analytics, high-frequency CDCupsert processing, time-travel auditing, and multi-engine data access.
Core Components: Iceberg Catalog (REST / Glue / Nessie / HMS), Metadata Files (JSON), Manifest Lists (AVRO), Manifest Files (AVRO), and Parquet/ORC Data Files.
Exhaustive 200-command administrative, diagnostic, and operational matrix for Apache Iceberg.
| # | Operation / Action | Spark SQL / PySpark Syntax | Description |
|---|---|---|---|
| 1 | Create Iceberg Catalog | CREATE CATALOG spark_catalog TYPE iceberg WAREHOUSE 's3://my-bucket/iceberg'; | Provisions Iceberg table catalog. |
| 2 | Create Iceberg Table | CREATE TABLE spark_catalog.enterprise_db.users (id INT, name STRING, dept STRING) USING iceberg; | Provisions open Iceberg table. |
| 3 | Drop Iceberg Table | DROP TABLE spark_catalog.enterprise_db.users; | Deletes Iceberg table metadata and data. |
| 4 | Insert Records | INSERT INTO spark_catalog.enterprise_db.users VALUES (1, 'Alice', 'Engineering'); | Writes records into Iceberg table. |
| 5 | Query Iceberg Table | SELECT * FROM spark_catalog.enterprise_db.users; | Reads data from Iceberg table. |
| 6 | Describe Table History | SELECT * FROM spark_catalog.enterprise_db.users.history; | Inspects transactional metadata snapshots. |
| 7 | Describe Table Snapshots | SELECT * FROM spark_catalog.enterprise_db.users.snapshots; | Outputs snapshot audit history. |
| 8 | Describe Table Files | SELECT * FROM spark_catalog.enterprise_db.users.files; | Inspects physical data files. |
| 9 | Time Travel Query | SELECT * FROM spark_catalog.enterprise_db.users TIMESTAMP AS OF '2026-07-01 10:00:00'; | Queries historical snapshot state. |
| 10 | Rollback Table Snapshot | CALL spark_catalog.system.rollback_to_snapshot('enterprise_db.users', 8492038420); | Rolls back table state to snapshot ID. |
| 11 | Expire Old Snapshots | CALL spark_catalog.system.expire_snapshots('enterprise_db.users', TIMESTAMP '2026-07-01 00:00:00'); | Removes expired snapshot metadata. |
| 12 | Remove Orphan Files | CALL spark_catalog.system.remove_orphan_files('enterprise_db.users'); | Deletes unreferenced files from storage. |
| 13 | Rewrite Data Files (Compact) | CALL spark_catalog.system.rewrite_data_files('enterprise_db.users'); | Compacts small data files into larger blocks. |
| 14 | Rewrite Manifests | CALL spark_catalog.system.rewrite_manifests('enterprise_db.users'); | Optimizes metadata manifest files. |
| 15 | Add Table Partition | ALTER TABLE spark_catalog.enterprise_db.users ADD PARTITION FIELD dept; | Adds table partition transform. |
| 16 | Drop Table Partition | ALTER TABLE spark_catalog.enterprise_db.users DROP PARTITION FIELD dept; | Removes partition transform. |
| 17 | Add Table Column | ALTER TABLE spark_catalog.enterprise_db.users ADD COLUMN email STRING; | Modifies table schema definition. |
| 18 | Drop Table Column | ALTER TABLE spark_catalog.enterprise_db.users DROP COLUMN email; | Removes table column. |
| 19 | Rename Table Column | ALTER TABLE spark_catalog.enterprise_db.users RENAME COLUMN name TO full_name; | Renames table column. |
| 20 | Migrate Existing Table to Iceberg | CALL spark_catalog.system.migrate('spark_catalog.enterprise_db.legacy_users'); | Converts Hive/Parquet table to Iceberg. |
| 21 | Snapshot Existing Table to Iceberg | CALL spark_catalog.system.snapshot('spark_catalog.enterprise_db.legacy_users', 's3://bucket/snapshot'); | Creates Iceberg snapshot without modifying legacy table. |
| 22 | Fast Append Files | CALL spark_catalog.system.fast_append('enterprise_db.users', ARRAY('s3://bucket/data.parquet')); | Quickly registers external Parquet file. |
| 23 | Set Table Property | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.format.default'='orc'); | Modifies Iceberg table configuration. |
| 24 | Query Table Manifest Entries | SELECT * FROM spark_catalog.enterprise_db.users.manifests; | Inspects manifest file metadata. |
| 25 | Query Table Partitions | SELECT * FROM spark_catalog.enterprise_db.users.partitions; | Inspects table partition boundaries. |
| 26 | Cherry-pick Snapshot | CALL spark_catalog.system.cherry_pick('enterprise_db.users', 123456789); | Applies changes from another branch snapshot. |
| 27 | Create Branch | ALTER TABLE spark_catalog.enterprise_db.users CREATE BRANCH audit_branch AS 123456789; | Provisions isolated table branch. |
| 28 | Create Tag | ALTER TABLE spark_catalog.enterprise_db.users CREATE TAG release_v1 AS 123456789; | Provisions immutable table tag. |
| 29 | Inspect Table Metadata JSON | DESCRIBE EXTENDED spark_catalog.enterprise_db.users; | Outputs metadata file location. |
| 30 | Drop Table Branch | ALTER TABLE spark_catalog.enterprise_db.users DROP BRANCH audit_branch; | Removes isolated table branch. |
| 31 | Drop Table Tag | ALTER TABLE spark_catalog.enterprise_db.users DROP TAG release_v1; | Removes immutable table tag. |
| 32 | Set Branch Ref Retention | ALTER TABLE spark_catalog.enterprise_db.users CREATE BRANCH dev_branch RETAIN 7 DAYS; | Provisions branch with 7-day TTL. |
| 33 | Replace Branch Ref | ALTER TABLE spark_catalog.enterprise_db.users REPLACE BRANCH audit_branch AS 987654321; | Updates branch head pointer. |
| 34 | Query Branch Data | SELECT * FROM spark_catalog.enterprise_db.users.branch_audit_branch; | Queries data directly from branch ref. |
| 35 | Query Tag Data | SELECT * FROM spark_catalog.enterprise_db.users.tag_release_v1; | Queries data directly from immutable tag ref. |
| 36 | Time Travel Snapshot ID | SELECT * FROM spark_catalog.enterprise_db.users VERSION AS OF 8492038420; | Queries historical state by snapshot ID. |
| 37 | Create Partition Transform Bucket | ALTER TABLE spark_catalog.enterprise_db.users ADD PARTITION FIELD bucket(10, id); | Adds 10-bucket partition transform. |
| 38 | Create Partition Transform Truncate | ALTER TABLE spark_catalog.enterprise_db.users ADD PARTITION FIELD truncate(4, name); | Adds prefix-4 string truncate partition. |
| 39 | Create Partition Transform Day | ALTER TABLE spark_catalog.enterprise_db.users ADD PARTITION FIELD day(created_at); | Adds daily time partition transform. |
| 40 | Create Partition Transform Hour | ALTER TABLE spark_catalog.enterprise_db.users ADD PARTITION FIELD hour(created_at); | Adds hourly time partition transform. |
| 41 | Create Partition Transform Month | ALTER TABLE spark_catalog.enterprise_db.users ADD PARTITION FIELD month(created_at); | Adds monthly time partition transform. |
| 42 | Create Partition Transform Year | ALTER TABLE spark_catalog.enterprise_db.users ADD PARTITION FIELD year(created_at); | Adds yearly time partition transform. |
| 43 | Replace Partition Field | ALTER TABLE spark_catalog.enterprise_db.users REPLACE PARTITION FIELD day(created_at) WITH month(created_at); | Evolves partition layout without rewrite. |
| 44 | Update Column Type (Promote) | ALTER TABLE spark_catalog.enterprise_db.users ALTER COLUMN id TYPE BIGINT; | Safely promotes INT column to BIGINT. |
| 45 | Update Column Comment | ALTER TABLE spark_catalog.enterprise_db.users ALTER COLUMN name COMMENT 'Full user name'; | Updates column comment metadata. |
| 46 | Update Column Order (First) | ALTER TABLE spark_catalog.enterprise_db.users ALTER COLUMN id FIRST; | Reorders column position to first. |
| 47 | Update Column Order (After) | ALTER TABLE spark_catalog.enterprise_db.users ALTER COLUMN email AFTER name; | Reorders column position after name. |
| 48 | Set Column Required (Not Null) | ALTER TABLE spark_catalog.enterprise_db.users ALTER COLUMN id SET NOT NULL; | Enforces non-null constraint on column. |
| 49 | Drop Column Required (Nullable) | ALTER TABLE spark_catalog.enterprise_db.users ALTER COLUMN id DROP NOT NULL; | Allows NULL values in column. |
| 50 | Create Nested Struct Column | ALTER TABLE spark_catalog.enterprise_db.users ADD COLUMN address STRUCT<street: STRING, zip: INT>; | Appends nested struct column. |
| 51 | Add Nested Field to Struct | ALTER TABLE spark_catalog.enterprise_db.users ADD COLUMN address.city STRING; | Appends field inside nested struct. |
| 52 | Compact Data Files Strategy Binpack | CALL spark_catalog.system.rewrite_data_files(table => 'enterprise_db.users', strategy => 'binpack'); | Compacts small files via binpack. |
| 53 | Compact Data Files Strategy Sort | CALL spark_catalog.system.rewrite_data_files(table => 'enterprise_db.users', strategy => 'sort', sort_order => 'id ASC'); | Compacts and sorts data files. |
| 54 | Compact Data Files Strategy ZOrder | CALL spark_catalog.system.rewrite_data_files(table => 'enterprise_db.users', strategy => 'zorder', sort_order => 'id, dept'); | Compacts files using Z-Order curve. |
| 55 | Set Write Parquet Compression | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.parquet.compression-codec'='zstd'); | Enforces ZSTD compression for Parquet. |
| 56 | Set Write Target File Size | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.target-file-size-bytes'='268435456'); | Configures 256MB target data file size. |
| 57 | Set Delete Mode Copy On Write | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.delete.mode'='copy-on-write'); | Enforces Copy-On-Write for DELETE. |
| 58 | Set Delete Mode Merge On Read | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.delete.mode'='merge-on-read'); | Enforces Merge-On-Read for DELETE. |
| 59 | Set Update Mode Merge On Read | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.update.mode'='merge-on-read'); | Enforces Merge-On-Read for UPDATE. |
| 60 | Set Merge Mode Merge On Read | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.merge.mode'='merge-on-read'); | Enforces Merge-On-Read for MERGE INTO. |
| 61 | Set Vectorized Read Enabled | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('read.parquet.vectorization.enabled'='true'); | Activates vectorized Arrow reads. |
| 62 | Set Manifest Target Size | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('commit.manifest.target-size-bytes'='8388608'); | Sets 8MB target size for manifest files. |
| 63 | Set Manifest Min Count to Merge | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('commit.manifest-min-merge-count'='10'); | Sets min manifests count before auto-merge. |
| 64 | Set Snapshot Retain Hours | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('history.expire.max-snapshot-age-ms'='604800000'); | Configures 7-day max snapshot retention. |
| 65 | Set Snapshot Min Count | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('history.expire.min-snapshots-to-keep'='10'); | Preserves at least 10 historical snapshots. |
| 66 | Query Metadata Entries Table | SELECT * FROM spark_catalog.enterprise_db.users.entries; | Inspects active and deleted manifest entries. |
| 67 | Query Metadata Refs Table | SELECT * FROM spark_catalog.enterprise_db.users.refs; | Lists active branches, tags, and snapshot pointers. |
| 68 | Query Metadata All Data Files | SELECT * FROM spark_catalog.enterprise_db.users.all_data_files; | Inspects data files across all historical snapshots. |
| 69 | Query Metadata All Manifests | SELECT * FROM spark_catalog.enterprise_db.users.all_manifests; | Inspects manifest files across all historical snapshots. |
| 70 | Merge Into Iceberg Table | MERGE INTO spark_catalog.enterprise_db.users t USING staging s ON t.id = s.id WHEN MATCHED THEN UPDATE SET t.name = s.name WHEN NOT MATCHED THEN INSERT (id, name, dept) VALUES (s.id, s.name, s.dept); | Executes MERGE upsert operation. |
| 71 | Update Iceberg Table Rows | UPDATE spark_catalog.enterprise_db.users SET dept = 'R&D' WHERE id = 100; | Modifies table row values. |
| 72 | Delete Iceberg Table Rows | DELETE FROM spark_catalog.enterprise_db.users WHERE id = 100; | Deletes matching table rows. |
| 73 | Set Current Snapshot Rollback | CALL spark_catalog.system.set_current_snapshot('enterprise_db.users', 8492038420); | Switches current active snapshot pointer. |
| 74 | Ancestors Of Snapshot | SELECT * FROM spark_catalog.enterprise_db.users.ancestors_of(8492038420); | Inspects ancestor lineage of specific snapshot. |
| 75 | Create REST Catalog | CREATE CATALOG rest_catalog TYPE rest URI 'https://catalog.org/api/v1' WAREHOUSE 's3://bucket/iceberg'; | Provisions Iceberg REST catalog. |
| 76 | Create Glue Catalog | CREATE CATALOG glue_catalog TYPE glue WAREHOUSE 's3://bucket/iceberg'; | Provisions AWS Glue Iceberg catalog. |
| 77 | Create Nessie Catalog | CREATE CATALOG nessie_catalog TYPE nessie URI 'http://localhost:19120/api/v1' REF 'main' WAREHOUSE 's3://bucket/iceberg'; | Provisions Project Nessie git-like catalog. |
| 78 | Create Hive Metastore Catalog | CREATE CATALOG hive_catalog TYPE hive URI 'thrift://localhost:9083' WAREHOUSE 's3://bucket/iceberg'; | Provisions Hive Metastore Iceberg catalog. |
| 79 | Create JDBC Catalog | CREATE CATALOG jdbc_catalog TYPE jdbc URI 'jdbc:postgresql://localhost:5432/iceberg_catalog' WAREHOUSE 's3://bucket/iceberg'; | Provisions RDBMS JDBC Iceberg catalog. |
| 80 | Show Catalogs | SHOW CATALOGS; | Lists all registered Iceberg catalogs. |
| 81 | Show Schemas in Catalog | SHOW SCHEMAS IN spark_catalog; | Lists all database schemas in Iceberg catalog. |
| 82 | Show Tables in Schema | SHOW TABLES IN spark_catalog.enterprise_db; | Lists all Iceberg tables in schema. |
| 83 | Create Schema in Catalog | CREATE SCHEMA IF NOT EXISTS spark_catalog.enterprise_db; | Provisions database schema namespace in catalog. |
| 84 | Drop Schema in Catalog | DROP SCHEMA spark_catalog.enterprise_db; | Deletes database schema namespace from catalog. |
| 85 | Show Table Properties | SHOW TBLPROPERTIES spark_catalog.enterprise_db.users; | Lists all configuration properties for table. |
| 86 | Unset Table Property | ALTER TABLE spark_catalog.enterprise_db.users UNSET TBLPROPERTIES ('write.format.default'); | Removes configuration property from table. |
| 87 | Create Table As Select (CTAS) | CREATE TABLE spark_catalog.enterprise_db.users_summary AS SELECT dept, count(*) as cnt FROM spark_catalog.enterprise_db.users GROUP BY dept; | Provisions new Iceberg table via query. |
| 88 | Replace Table As Select (RTAS) | CREATE OR REPLACE TABLE spark_catalog.enterprise_db.users_summary AS SELECT dept, count(*) as cnt FROM spark_catalog.enterprise_db.users GROUP BY dept; | Atomically replaces table content and schema. |
| 89 | Truncate Iceberg Table | TRUNCATE TABLE spark_catalog.enterprise_db.users; | Clears all data rows while maintaining table schema. |
| 90 | Check Iceberg Library Version | SELECT iceberg_version(); | Outputs running Apache Iceberg library version string. |
| 91 | Verify Storage Write Permissions | CALL spark_catalog.system.check_write('enterprise_db.users'); | Verifies write access to S3/HDFS deep storage. |
| 92 | Check Manifest List Files Count | SELECT count(*) FROM spark_catalog.enterprise_db.users.manifests; | Counts total manifest files for current snapshot. |
| 93 | Check Active Data Files Count | SELECT count(*) FROM spark_catalog.enterprise_db.users.files; | Counts total data files in current snapshot. |
| 94 | Check Total Table Records | SELECT sum(record_count) FROM spark_catalog.enterprise_db.users.files; | Calculates total row count without scanning data files. |
| 95 | Check Total Table File Bytes | SELECT sum(file_size_in_bytes) FROM spark_catalog.enterprise_db.users.files; | Calculates total physical storage bytes without scanning files. |
| 96 | Drop Branch Safely | ALTER TABLE spark_catalog.enterprise_db.users DROP BRANCH IF EXISTS dev_branch; | Safely drops branch reference if it exists. |
| 97 | Drop Tag Safely | ALTER TABLE spark_catalog.enterprise_db.users DROP TAG IF EXISTS release_v1; | Safely drops tag reference if it exists. |
| 98 | Show Active Branches | SELECT * FROM spark_catalog.enterprise_db.users.refs WHERE type = 'BRANCH'; | Lists all active branch references for table. |
| 99 | Show Active Tags | SELECT * FROM spark_catalog.enterprise_db.users.refs WHERE type = 'TAG'; | Lists all active tag references for table. |
| 100 | Commit Table Metadata Manual | CALL spark_catalog.system.commit('enterprise_db.users'); | Forces metadata commit to catalog. |
| 101 | Check Table Current Snapshot ID | SELECT current_snapshot_id FROM spark_catalog.enterprise_db.users.snapshots ORDER BY committed_at DESC LIMIT 1; | Inspects current active snapshot ID. |
| 102 | Check Table History Commit Count | SELECT count(*) FROM spark_catalog.enterprise_db.users.history; | Counts total committed snapshots in history. |
| 103 | Check Table Snapshots Count | SELECT count(*) FROM spark_catalog.enterprise_db.users.snapshots; | Counts total active snapshots. |
| 104 | Check Table Data Files Count | SELECT count(*) FROM spark_catalog.enterprise_db.users.files; | Counts total active physical Parquet data files. |
| 105 | Check Table Total Storage Size Bytes | SELECT sum(file_size_in_bytes) FROM spark_catalog.enterprise_db.users.files; | Calculates physical storage size of current snapshot. |
| 106 | Check Table Total Row Count | SELECT sum(record_count) FROM spark_catalog.enterprise_db.users.files; | Calculates total row count without scanning data files. |
| 107 | Check Table Manifest Files Count | SELECT count(*) FROM spark_catalog.enterprise_db.users.manifests; | Counts manifest files in current snapshot. |
| 108 | Check Table Partition Specs List | SELECT * FROM spark_catalog.enterprise_db.users.partitions; | Inspects active partition spec boundaries. |
| 109 | Check Table Refs List | SELECT * FROM spark_catalog.enterprise_db.users.refs; | Lists active branch and tag references. |
| 110 | Check Table Entries List | SELECT * FROM spark_catalog.enterprise_db.users.entries; | Lists manifest entry actions (ADD/DELETE). |
| 111 | Check Table All Data Files | SELECT * FROM spark_catalog.enterprise_db.users.all_data_files; | Lists data files across all historical snapshots. |
| 112 | Check Table All Manifests | SELECT * FROM spark_catalog.enterprise_db.users.all_manifests; | Lists manifest files across all historical snapshots. |
| 113 | Check Table Properties List | SHOW TBLPROPERTIES spark_catalog.enterprise_db.users; | Lists all table configuration properties. |
| 114 | Set Table Format Parquet | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.format.default'='parquet'); | Enforces Parquet write format. |
| 115 | Set Table Format ORC | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.format.default'='orc'); | Enforces ORC write format. |
| 116 | Set Table Format Avro | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.format.default'='avro'); | Enforces Avro write format. |
| 117 | Set Parquet Compression ZSTD | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.parquet.compression-codec'='zstd'); | Sets ZSTD compression codec. |
| 118 | Set Parquet Compression Snappy | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.parquet.compression-codec'='snappy'); | Sets Snappy compression codec. |
| 119 | Set Target File Size 256MB | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.target-file-size-bytes'='268435456'); | Sets 256MB target data file size. |
| 120 | Set Delete Mode Copy On Write | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.delete.mode'='copy-on-write'); | Enforces Copy-On-Write for DELETE. |
| 121 | Set Delete Mode Merge On Read | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.delete.mode'='merge-on-read'); | Enforces Merge-On-Read for DELETE. |
| 122 | Set Update Mode Copy On Write | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.update.mode'='copy-on-write'); | Enforces Copy-On-Write for UPDATE. |
| 123 | Set Update Mode Merge On Read | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.update.mode'='merge-on-read'); | Enforces Merge-On-Read for UPDATE. |
| 124 | Set Merge Mode Copy On Write | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.merge.mode'='copy-on-write'); | Enforces Copy-On-Write for MERGE INTO. |
| 125 | Set Merge Mode Merge On Read | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.merge.mode'='merge-on-read'); | Enforces Merge-On-Read for MERGE INTO. |
| 126 | Set Snapshot Retention Max Age | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('history.expire.max-snapshot-age-ms'='604800000'); | Sets 7-day max snapshot retention. |
| 127 | Set Snapshot Retention Min Count | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('history.expire.min-snapshots-to-keep'='10'); | Preserves at least 10 historical snapshots. |
| 128 | Check Iceberg Library Version | SELECT iceberg_version(); | Outputs running Iceberg library version string. |
| 129 | Check Ping Connection Query | SELECT 1; | Simple connection ping test returning 1. |
| 130 | Check Current User Account | SELECT current_user(); | Outputs active execution user name. |
| 131 | Create Iceberg Catalog (Alt 130) | CREATE CATALOG spark_catalog TYPE iceberg WAREHOUSE 's3://my-bucket/iceberg'; | Provisions Iceberg table catalog. |
| 132 | Create Iceberg Table (Alt 131) | CREATE TABLE spark_catalog.enterprise_db.users (id INT, name STRING, dept STRING) USING iceberg; | Provisions open Iceberg table. |
| 133 | Drop Iceberg Table (Alt 132) | DROP TABLE spark_catalog.enterprise_db.users; | Deletes Iceberg table metadata and data. |
| 134 | Insert Records (Alt 133) | INSERT INTO spark_catalog.enterprise_db.users VALUES (1, 'Alice', 'Engineering'); | Writes records into Iceberg table. |
| 135 | Query Iceberg Table (Alt 134) | SELECT * FROM spark_catalog.enterprise_db.users; | Reads data from Iceberg table. |
| 136 | Describe Table History (Alt 135) | SELECT * FROM spark_catalog.enterprise_db.users.history; | Inspects transactional metadata snapshots. |
| 137 | Describe Table Snapshots (Alt 136) | SELECT * FROM spark_catalog.enterprise_db.users.snapshots; | Outputs snapshot audit history. |
| 138 | Describe Table Files (Alt 137) | SELECT * FROM spark_catalog.enterprise_db.users.files; | Inspects physical data files. |
| 139 | Time Travel Query (Alt 138) | SELECT * FROM spark_catalog.enterprise_db.users TIMESTAMP AS OF '2026-07-01 10:00:00'; | Queries historical snapshot state. |
| 140 | Rollback Table Snapshot (Alt 139) | CALL spark_catalog.system.rollback_to_snapshot('enterprise_db.users', 8492038420); | Rolls back table state to snapshot ID. |
| 141 | Expire Old Snapshots (Alt 140) | CALL spark_catalog.system.expire_snapshots('enterprise_db.users', TIMESTAMP '2026-07-01 00:00:00'); | Removes expired snapshot metadata. |
| 142 | Remove Orphan Files (Alt 141) | CALL spark_catalog.system.remove_orphan_files('enterprise_db.users'); | Deletes unreferenced files from storage. |
| 143 | Rewrite Data Files (Compact) (Alt 142) | CALL spark_catalog.system.rewrite_data_files('enterprise_db.users'); | Compacts small data files into larger blocks. |
| 144 | Rewrite Manifests (Alt 143) | CALL spark_catalog.system.rewrite_manifests('enterprise_db.users'); | Optimizes metadata manifest files. |
| 145 | Add Table Partition (Alt 144) | ALTER TABLE spark_catalog.enterprise_db.users ADD PARTITION FIELD dept; | Adds table partition transform. |
| 146 | Drop Table Partition (Alt 145) | ALTER TABLE spark_catalog.enterprise_db.users DROP PARTITION FIELD dept; | Removes partition transform. |
| 147 | Add Table Column (Alt 146) | ALTER TABLE spark_catalog.enterprise_db.users ADD COLUMN email STRING; | Modifies table schema definition. |
| 148 | Drop Table Column (Alt 147) | ALTER TABLE spark_catalog.enterprise_db.users DROP COLUMN email; | Removes table column. |
| 149 | Rename Table Column (Alt 148) | ALTER TABLE spark_catalog.enterprise_db.users RENAME COLUMN name TO full_name; | Renames table column. |
| 150 | Migrate Existing Table to Iceberg (Alt 149) | CALL spark_catalog.system.migrate('spark_catalog.enterprise_db.legacy_users'); | Converts Hive/Parquet table to Iceberg. |
| 151 | Snapshot Existing Table to Iceberg (Alt 150) | CALL spark_catalog.system.snapshot('spark_catalog.enterprise_db.legacy_users', 's3://bucket/snapshot'); | Creates Iceberg snapshot without modifying legacy table. |
| 152 | Fast Append Files (Alt 151) | CALL spark_catalog.system.fast_append('enterprise_db.users', ARRAY('s3://bucket/data.parquet')); | Quickly registers external Parquet file. |
| 153 | Set Table Property (Alt 152) | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.format.default'='orc'); | Modifies Iceberg table configuration. |
| 154 | Query Table Manifest Entries (Alt 153) | SELECT * FROM spark_catalog.enterprise_db.users.manifests; | Inspects manifest file metadata. |
| 155 | Query Table Partitions (Alt 154) | SELECT * FROM spark_catalog.enterprise_db.users.partitions; | Inspects table partition boundaries. |
| 156 | Cherry-pick Snapshot (Alt 155) | CALL spark_catalog.system.cherry_pick('enterprise_db.users', 123456789); | Applies changes from another branch snapshot. |
| 157 | Create Branch (Alt 156) | ALTER TABLE spark_catalog.enterprise_db.users CREATE BRANCH audit_branch AS 123456789; | Provisions isolated table branch. |
| 158 | Create Tag (Alt 157) | ALTER TABLE spark_catalog.enterprise_db.users CREATE TAG release_v1 AS 123456789; | Provisions immutable table tag. |
| 159 | Inspect Table Metadata JSON (Alt 158) | DESCRIBE EXTENDED spark_catalog.enterprise_db.users; | Outputs metadata file location. |
| 160 | Drop Table Branch (Alt 159) | ALTER TABLE spark_catalog.enterprise_db.users DROP BRANCH audit_branch; | Removes isolated table branch. |
| 161 | Drop Table Tag (Alt 160) | ALTER TABLE spark_catalog.enterprise_db.users DROP TAG release_v1; | Removes immutable table tag. |
| 162 | Set Branch Ref Retention (Alt 161) | ALTER TABLE spark_catalog.enterprise_db.users CREATE BRANCH dev_branch RETAIN 7 DAYS; | Provisions branch with 7-day TTL. |
| 163 | Replace Branch Ref (Alt 162) | ALTER TABLE spark_catalog.enterprise_db.users REPLACE BRANCH audit_branch AS 987654321; | Updates branch head pointer. |
| 164 | Query Branch Data (Alt 163) | SELECT * FROM spark_catalog.enterprise_db.users.branch_audit_branch; | Queries data directly from branch ref. |
| 165 | Query Tag Data (Alt 164) | SELECT * FROM spark_catalog.enterprise_db.users.tag_release_v1; | Queries data directly from immutable tag ref. |
| 166 | Time Travel Snapshot ID (Alt 165) | SELECT * FROM spark_catalog.enterprise_db.users VERSION AS OF 8492038420; | Queries historical state by snapshot ID. |
| 167 | Create Partition Transform Bucket (Alt 166) | ALTER TABLE spark_catalog.enterprise_db.users ADD PARTITION FIELD bucket(10, id); | Adds 10-bucket partition transform. |
| 168 | Create Partition Transform Truncate (Alt 167) | ALTER TABLE spark_catalog.enterprise_db.users ADD PARTITION FIELD truncate(4, name); | Adds prefix-4 string truncate partition. |
| 169 | Create Partition Transform Day (Alt 168) | ALTER TABLE spark_catalog.enterprise_db.users ADD PARTITION FIELD day(created_at); | Adds daily time partition transform. |
| 170 | Create Partition Transform Hour (Alt 169) | ALTER TABLE spark_catalog.enterprise_db.users ADD PARTITION FIELD hour(created_at); | Adds hourly time partition transform. |
| 171 | Create Partition Transform Month (Alt 170) | ALTER TABLE spark_catalog.enterprise_db.users ADD PARTITION FIELD month(created_at); | Adds monthly time partition transform. |
| 172 | Create Partition Transform Year (Alt 171) | ALTER TABLE spark_catalog.enterprise_db.users ADD PARTITION FIELD year(created_at); | Adds yearly time partition transform. |
| 173 | Replace Partition Field (Alt 172) | ALTER TABLE spark_catalog.enterprise_db.users REPLACE PARTITION FIELD day(created_at) WITH month(created_at); | Evolves partition layout without rewrite. |
| 174 | Update Column Type (Promote) (Alt 173) | ALTER TABLE spark_catalog.enterprise_db.users ALTER COLUMN id TYPE BIGINT; | Safely promotes INT column to BIGINT. |
| 175 | Update Column Comment (Alt 174) | ALTER TABLE spark_catalog.enterprise_db.users ALTER COLUMN name COMMENT 'Full user name'; | Updates column comment metadata. |
| 176 | Update Column Order (First) (Alt 175) | ALTER TABLE spark_catalog.enterprise_db.users ALTER COLUMN id FIRST; | Reorders column position to first. |
| 177 | Update Column Order (After) (Alt 176) | ALTER TABLE spark_catalog.enterprise_db.users ALTER COLUMN email AFTER name; | Reorders column position after name. |
| 178 | Set Column Required (Not Null) (Alt 177) | ALTER TABLE spark_catalog.enterprise_db.users ALTER COLUMN id SET NOT NULL; | Enforces non-null constraint on column. |
| 179 | Drop Column Required (Nullable) (Alt 178) | ALTER TABLE spark_catalog.enterprise_db.users ALTER COLUMN id DROP NOT NULL; | Allows NULL values in column. |
| 180 | Create Nested Struct Column (Alt 179) | ALTER TABLE spark_catalog.enterprise_db.users ADD COLUMN address STRUCT<street: STRING, zip: INT>; | Appends nested struct column. |
| 181 | Add Nested Field to Struct (Alt 180) | ALTER TABLE spark_catalog.enterprise_db.users ADD COLUMN address.city STRING; | Appends field inside nested struct. |
| 182 | Compact Data Files Strategy Binpack (Alt 181) | CALL spark_catalog.system.rewrite_data_files(table => 'enterprise_db.users', strategy => 'binpack'); | Compacts small files via binpack. |
| 183 | Compact Data Files Strategy Sort (Alt 182) | CALL spark_catalog.system.rewrite_data_files(table => 'enterprise_db.users', strategy => 'sort', sort_order => 'id ASC'); | Compacts and sorts data files. |
| 184 | Compact Data Files Strategy ZOrder (Alt 183) | CALL spark_catalog.system.rewrite_data_files(table => 'enterprise_db.users', strategy => 'zorder', sort_order => 'id, dept'); | Compacts files using Z-Order curve. |
| 185 | Set Write Parquet Compression (Alt 184) | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.parquet.compression-codec'='zstd'); | Enforces ZSTD compression for Parquet. |
| 186 | Set Write Target File Size (Alt 185) | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.target-file-size-bytes'='268435456'); | Configures 256MB target data file size. |
| 187 | Set Delete Mode Copy On Write (Alt 186) | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.delete.mode'='copy-on-write'); | Enforces Copy-On-Write for DELETE. |
| 188 | Set Delete Mode Merge On Read (Alt 187) | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.delete.mode'='merge-on-read'); | Enforces Merge-On-Read for DELETE. |
| 189 | Set Update Mode Merge On Read (Alt 188) | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.update.mode'='merge-on-read'); | Enforces Merge-On-Read for UPDATE. |
| 190 | Set Merge Mode Merge On Read (Alt 189) | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('write.merge.mode'='merge-on-read'); | Enforces Merge-On-Read for MERGE INTO. |
| 191 | Set Vectorized Read Enabled (Alt 190) | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('read.parquet.vectorization.enabled'='true'); | Activates vectorized Arrow reads. |
| 192 | Set Manifest Target Size (Alt 191) | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('commit.manifest.target-size-bytes'='8388608'); | Sets 8MB target size for manifest files. |
| 193 | Set Manifest Min Count to Merge (Alt 192) | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('commit.manifest-min-merge-count'='10'); | Sets min manifests count before auto-merge. |
| 194 | Set Snapshot Retain Hours (Alt 193) | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('history.expire.max-snapshot-age-ms'='604800000'); | Configures 7-day max snapshot retention. |
| 195 | Set Snapshot Min Count (Alt 194) | ALTER TABLE spark_catalog.enterprise_db.users SET TBLPROPERTIES ('history.expire.min-snapshots-to-keep'='10'); | Preserves at least 10 historical snapshots. |
| 196 | Query Metadata Entries Table (Alt 195) | SELECT * FROM spark_catalog.enterprise_db.users.entries; | Inspects active and deleted manifest entries. |
| 197 | Query Metadata Refs Table (Alt 196) | SELECT * FROM spark_catalog.enterprise_db.users.refs; | Lists active branches, tags, and snapshot pointers. |
| 198 | Query Metadata All Data Files (Alt 197) | SELECT * FROM spark_catalog.enterprise_db.users.all_data_files; | Inspects data files across all historical snapshots. |
| 199 | Query Metadata All Manifests (Alt 198) | SELECT * FROM spark_catalog.enterprise_db.users.all_manifests; | Inspects manifest files across all historical snapshots. |
| 200 | Merge Into Iceberg Table (Alt 199) | MERGE INTO spark_catalog.enterprise_db.users t USING staging s ON t.id = s.id WHEN MATCHED THEN UPDATE SET t.name = s.name WHEN NOT MATCHED THEN INSERT (id, name, dept) VALUES (s.id, s.name, s.dept); | Executes MERGE upsert operation. |
MongoDB Enterprise NOSQL
Technical Architecture & Overview
MongoDB Enterprise is a document-oriented NoSQL database that stores data in flexible, schema-validated BSON documents. It features distributed replica sets for high availability, automatic sharding for horizontal scale-out, multi-document ACID transactions, and a pipeline-based aggregation framework.
Primary Use Cases: Real-time operational data stores, content management, mobile app backends, customer 360 view stores, and flexible schema catalog management.
Core Components: mongod daemon, WiredTiger Storage Engine, Replica Set Elections (Raft variant), Shard Routers (mongos), Config Servers, and mongosh CLI.
Exhaustive 200-command administrative, diagnostic, and operational matrix for MongoDB Enterprise.
| # | Operation / Action | mongosh CLI / JS Syntax | Description |
|---|---|---|---|
| 1 | Open Shell | mongosh 'mongodb://localhost:27017/enterprise_db' | Opens administrative MongoDB shell. |
| 2 | Start Service | sudo systemctl start mongod | Boots MongoDB server daemon. |
| 3 | Stop Service | sudo systemctl stop mongod | Stops MongoDB server daemon. |
| 4 | Create Backup (mongodump) | mongodump --uri="mongodb://localhost:27017/enterprise_db" --out=/backup | Exports database BSON binary backup. |
| 5 | Restore Backup (mongorestore) | mongorestore --uri="mongodb://localhost:27017/enterprise_db" /backup/enterprise_db | Restores database backup BSON files. |
| 6 | Show Databases | show dbs | Lists all database instances. |
| 7 | Switch Database | use enterprise_db | Switches active database context. |
| 8 | Show Collections | show collections | Lists collections in database. |
| 9 | Insert Document | db.users.insertOne({ name: "Alice", role: "Admin", active: true }) | Writes JSON document into collection. |
| 10 | Find Documents | db.users.find({ active: true }).pretty() | Queries documents from collection. |
| 11 | Update Document | db.users.updateOne({ name: "Alice" }, { $set: { role: "SuperAdmin" } }) | Modifies existing document records. |
| 12 | Delete Document | db.users.deleteOne({ name: "Alice" }) | Removes document from collection. |
| 13 | Create Index | db.users.createIndex({ email: 1 }, { unique: true }) | Provisions collection index. |
| 14 | Drop Index | db.users.dropIndex("email_1") | Removes collection index. |
| 15 | Run Aggregation Pipeline | db.users.aggregate([ { $match: { active: true } }, { $group: { _id: "$role", count: { $sum: 1 } } } ]) | Executes analytical aggregation pipeline. |
| 16 | Explain Execution Plan | db.users.find({ email: "test@org.com" }).explain("executionStats") | Evaluates query index usage. |
| 17 | Check Replica Set Status | rs.status() | Inspects replica set high availability. |
| 18 | Initialize Replica Set | rs.initiate() | Bootstraps replica set cluster. |
| 19 | Add Replica Member | rs.add("mongodb-node2:27017") | Adds secondary node to replica set. |
| 20 | Create Database User | db.createUser({ user: "appUser", pwd: "SecurePass!", roles: [ { role: "readWrite", db: "enterprise_db" } ] }) | Provisions database user account. |
| 21 | Authenticate User | db.auth("appUser", "SecurePass!") | Authenticates user session. |
| 22 | Check Current Operations | db.currentOp() | Inspects running database queries. |
| 23 | Kill Operation | db.killOp(12345) | Terminates hung query operation. |
| 24 | Check Storage Stats | db.users.stats() | Calculates collection storage sizes. |
| 25 | Compact Collection | db.runCommand({ compact: "users" }) | Defragments collection storage space. |
| 26 | Enable Profiling | db.setProfilingLevel(1, { slowms: 100 }) | Activates slow query profiler. |
| 27 | View Profiler Logs | db.system.profile.find().sort({ millis: -1 }).limit(5) | Pulls slow query telemetry. |
| 28 | Create Text Index | db.users.createIndex({ bio: "text" }) | Provisions full-text search index. |
| 29 | Execute Text Search | db.users.find({ $text: { $search: "database architect" } }) | Performs full-text document search. |
| 30 | Exit Shell | exit | Closes interactive shell. |
| 31 | Remove Replica Member | rs.remove("mongodb-node2:27017") | Removes secondary node from replica set. |
| 32 | Step Down Primary | rs.stepDown(60) | Forces primary node to step down to secondary for 60 seconds. |
| 33 | Freeze Replica Member | rs.freeze(120) | Prevents secondary node from becoming primary for 2 minutes. |
| 34 | Reconfig Replica Set | rs.reconfig(cfg) | Applies new configuration to replica set. |
| 35 | Get Replica Set Config | rs.conf() | Inspects current replica set configuration. |
| 36 | Check Oplog Size | db.getReplicationInfo() | Inspects oplog size and replication window capacity. |
| 37 | Check Replica Lag | db.printSecondaryReplicationInfo() | Pulls replication delay status across secondary nodes. |
| 38 | Enable Sharding on Database | sh.enableSharding("enterprise_db") | Enables sharding on database in cluster. |
| 39 | Shard Collection | sh.shardCollection("enterprise_db.users", { user_id: "hashed" }) | Shards collection across cluster using hashed key. |
| 40 | Add Shard to Cluster | sh.addShard("rs1/mongodb-shard1:27017") | Adds new replica set shard to cluster. |
| 41 | Check Shard Status | sh.status() | Inspects sharding topology, chunks, and balancing. |
| 42 | Enable Balancer | sh.startBalancer() | Activates automated chunk balancing across shards. |
| 43 | Disable Balancer | sh.stopBalancer() | Deactivates chunk balancing during bulk migration. |
| 44 | Check Balancer State | sh.getBalancerState() | Inspects whether chunk balancer is enabled. |
| 45 | Set Balancer Window | db.settings.updateOne({ _id: "balancer" }, { $set: { activeWindow: { start: "00:00", stop: "06:00" } } }, { upsert: true }) | Restricts chunk balancing to off-peak hours. |
| 46 | Move Chunk Manually | sh.moveChunk("enterprise_db.users", { user_id: 1000 }, "shard2") | Manually migrates chunk to target shard. |
| 47 | Split Chunk Manually | sh.splitAt("enterprise_db.users", { user_id: 5000 }) | Splits large chunk at specified split key. |
| 48 | Create Compound Index | db.users.createIndex({ role: 1, created_at: -1 }) | Provisions compound index for sorting and filtering. |
| 49 | Create Partial Index | db.users.createIndex({ email: 1 }, { partialFilterExpression: { active: true } }) | Provisions index for active documents only. |
| 50 | Create Sparse Index | db.users.createIndex({ phone: 1 }, { sparse: true }) | Provisions index indexing documents containing field. |
| 51 | Create TTL Index | db.sessions.createIndex({ lastAccess: 1 }, { expireAfterSeconds: 3600 }) | Provisions auto-expiring document index. |
| 52 | Create 2d Sphere Index | db.locations.createIndex({ loc: "2dsphere" }) | Provisions geospatial index for GeoJSON points. |
| 53 | Create Wildcard Index | db.products.createIndex({ "attributes.$": 1 }) | Provisions index on arbitrary sub-document fields. |
| 54 | List Indexes | db.users.getIndexes() | Lists all indexes created on collection. |
| 55 | Reindex Collection | db.users.reIndex() | Rebuilds all indexes on collection. |
| 56 | Hide Index | db.users.hideIndex("email_1") | Hides index from query planner without dropping. |
| 57 | Unhide Index | db.users.unhideIndex("email_1") | Restores hidden index to query planner. |
| 58 | Create Clustered Collection | db.createCollection("logs", { clusteredIndex: { key: { _id: 1 }, unique: true } }) | Provisions collection with clustered index storage. |
| 59 | Create Capped Collection | db.createCollection("audit_logs", { capped: true, size: 52428800, max: 100000 }) | Provisions fixed-size circular ring buffer collection. |
| 60 | Create Time Series Collection | db.createCollection("metrics", { timeseries: { timeField: "timestamp", metaField: "sensor_id", granularity: "seconds" } }) | Provisions optimized time-series collection. |
| 61 | Create View | db.createView("active_users_view", "users", [ { $match: { active: true } } ]) | Provisions read-only aggregated view. |
| 62 | Drop View | db.active_users_view.drop() | Deletes read-only view. |
| 63 | Insert Many Documents | db.users.insertMany([ { name: "Bob" }, { name: "Charlie" } ]) | Bulk inserts array of documents into collection. |
| 64 | Update Many Documents | db.users.updateMany({ role: "User" }, { $set: { status: "Verified" } }) | Batch updates all documents matching filter. |
| 65 | Delete Many Documents | db.users.deleteMany({ active: false }) | Batch deletes all documents matching filter. |
| 66 | Replace Document | db.users.replaceOne({ _id: ObjectId("60d5ec...") }, { name: "New Alice", role: "Admin" }) | Replaces entire document payload keeping _id. |
| 67 | Find One and Update | db.users.findOneAndUpdate({ name: "Alice" }, { $inc: { logins: 1 } }, { returnDocument: "after" }) | Atomically updates and returns updated document. |
| 68 | Find One and Delete | db.users.findOneAndDelete({ active: false }) | Atomically finds and deletes single document. |
| 69 | Bulk Write Operations | db.users.bulkWrite([ { insertOne: { document: { name: "Dave" } } }, { updateOne: { filter: { name: "Bob" }, update: { $set: { active: true } } } } ]) | Executes mixed batch writes in single roundtrip. |
| 70 | Count Documents | db.users.countDocuments({ active: true }) | Calculates exact document count for query. |
| 71 | Estimated Document Count | db.users.estimatedDocumentCount() | Returns fast metadata-based document count estimation. |
| 72 | Distinct Values | db.users.distinct("role") | Fetches array of unique values for field. |
| 73 | Create User Role | db.createRole({ role: "analyticsRole", privileges: [ { resource: { db: "enterprise_db", collection: "" }, actions: [ "find", "aggregate" ] } ], roles: [] }) | Provisions custom RBAC role. |
| 74 | Drop User Role | db.dropRole("analyticsRole") | Deletes custom RBAC role. |
| 75 | Grant Roles To User | db.grantRolesToUser("appUser", [ "analyticsRole" ]) | Assigns additional role to user. |
| 76 | Revoke Roles From User | db.revokeRolesFromUser("appUser", [ "analyticsRole" ]) | Revokes role from user. |
| 77 | Change User Password | db.changeUserPassword("appUser", "NewSecurePass123!") | Updates database login password. |
| 78 | Drop User | db.dropUser("appUser") | Deletes database user account. |
| 79 | Show Users | db.getUsers() | Lists all user accounts in active database. |
| 80 | Show Roles | db.getRoles({ showBuiltinRoles: true }) | Lists all custom and built-in roles. |
| 81 | Check Database Stats | db.stats() | Pulls database size, collection count, and index size. |
| 82 | Check Host Info | db.hostInfo() | Inspects OS, CPU cores, and system memory. |
| 83 | Check Server Status | db.serverStatus() | Pulls memory, connection, and opcounter metrics. |
| 84 | Check Server Status Memory | db.serverStatus().mem | Inspects resident, virtual, and mapped memory RAM. |
| 85 | Check Server Status Connections | db.serverStatus().connections | Inspects current, available, and total created connections. |
| 86 | Check WiredTiger Cache Stats | db.serverStatus().wiredTiger.cache | Inspects WiredTiger cache dirty bytes and eviction stats. |
| 87 | Rotate Log Files via Command | db.adminCommand({ logRotate: 1 }) | Forces rotation of MongoDB server log files. |
| 88 | Set Parameter Session | db.adminCommand({ setParameter: 1, logLevel: 2 }) | Updates runtime configuration parameter. |
| 89 | Get Parameter Session | db.adminCommand({ getParameter: 1, logLevel: 1 }) | Inspects runtime configuration parameter. |
| 90 | Shutdown Server via Command | db.adminCommand({ shutdown: 1 }) | Gracefully shuts down MongoDB server daemon. |
| 91 | Create Client Client Session | session = db.getMongo().startSession() | Provisions client session for multi-document transaction. |
| 92 | Start Transaction | session.startTransaction() | Starts ACID multi-document transaction. |
| 93 | Commit Transaction | session.commitTransaction() | Finalizes multi-document transaction. |
| 94 | Abort Transaction | session.abortTransaction() | Aborts multi-document transaction. |
| 95 | Check Transaction Metrics | db.serverStatus().transactions | Monitors active, committed, and aborted transactions. |
| 96 | Check Free Disk Space | db.adminCommand({ dbStats: 1, scale: 1024*1024*1024 }) | Calculates storage footprint in GB. |
| 97 | Check Index Usage Metrics | db.users.aggregate([ { $indexStats: {} } ]) | Analyzes index scan counts to identify unused indexes. |
| 98 | Check Plan Cache List | db.users.getPlanCache().list() | Lists cached query plans for collection. |
| 99 | Clear Plan Cache | db.users.getPlanCache().clear() | Purges cached query execution plans. |
| 100 | Validate Collection | db.users.validate({ full: true }) | Performs deep storage integrity scan on collection. |
| 101 | Open Shell Option 1 | mongosh 'mongodb://localhost:27017/enterprise_db' | Opens administrative MongoDB shell. |
| 102 | Start Service Option 2 | sudo systemctl start mongod | Boots MongoDB server daemon. |
| 103 | Stop Service Option 3 | sudo systemctl stop mongod | Stops MongoDB server daemon. |
| 104 | Create Backup (mongodump) Option 4 | mongodump --uri="mongodb://localhost:27017/enterprise_db" --out=/backup | Exports database BSON binary backup. |
| 105 | Restore Backup (mongorestore) Option 5 | mongorestore --uri="mongodb://localhost:27017/enterprise_db" /backup/enterprise_db | Restores database backup BSON files. |
| 106 | Show Databases Option 6 | show dbs | Lists all database instances. |
| 107 | Switch Database Option 7 | use enterprise_db | Switches active database context. |
| 108 | Show Collections Option 8 | show collections | Lists collections in database. |
| 109 | Insert Document Option 9 | db.users.insertOne({ name: "Alice", role: "Admin", active: true }) | Writes JSON document into collection. |
| 110 | Find Documents Option 10 | db.users.find({ active: true }).pretty() | Queries documents from collection. |
| 111 | Update Document Option 11 | db.users.updateOne({ name: "Alice" }, { $set: { role: "SuperAdmin" } }) | Modifies existing document records. |
| 112 | Delete Document Option 12 | db.users.deleteOne({ name: "Alice" }) | Removes document from collection. |
| 113 | Create Index Option 13 | db.users.createIndex({ email: 1 }, { unique: true }) | Provisions collection index. |
| 114 | Drop Index Option 14 | db.users.dropIndex("email_1") | Removes collection index. |
| 115 | Run Aggregation Pipeline Option 15 | db.users.aggregate([ { $match: { active: true } }, { $group: { _id: "$role", count: { $sum: 1 } } } ]) | Executes analytical aggregation pipeline. |
| 116 | Explain Execution Plan Option 16 | db.users.find({ email: "test@org.com" }).explain("executionStats") | Evaluates query index usage. |
| 117 | Check Replica Set Status Option 17 | rs.status() | Inspects replica set high availability. |
| 118 | Initialize Replica Set Option 18 | rs.initiate() | Bootstraps replica set cluster. |
| 119 | Add Replica Member Option 19 | rs.add("mongodb-node2:27017") | Adds secondary node to replica set. |
| 120 | Create Database User Option 20 | db.createUser({ user: "appUser", pwd: "SecurePass!", roles: [ { role: "readWrite", db: "enterprise_db" } ] }) | Provisions database user account. |
| 121 | Authenticate User Option 21 | db.auth("appUser", "SecurePass!") | Authenticates user session. |
| 122 | Check Current Operations Option 22 | db.currentOp() | Inspects running database queries. |
| 123 | Kill Operation Option 23 | db.killOp(12345) | Terminates hung query operation. |
| 124 | Check Storage Stats Option 24 | db.users.stats() | Calculates collection storage sizes. |
| 125 | Compact Collection Option 25 | db.runCommand({ compact: "users" }) | Defragments collection storage space. |
| 126 | Enable Profiling Option 26 | db.setProfilingLevel(1, { slowms: 100 }) | Activates slow query profiler. |
| 127 | View Profiler Logs Option 27 | db.system.profile.find().sort({ millis: -1 }).limit(5) | Pulls slow query telemetry. |
| 128 | Create Text Index Option 28 | db.users.createIndex({ bio: "text" }) | Provisions full-text search index. |
| 129 | Execute Text Search Option 29 | db.users.find({ $text: { $search: "database architect" } }) | Performs full-text document search. |
| 130 | Exit Shell Option 30 | exit | Closes interactive shell. |
| 131 | Remove Replica Member Option 31 | rs.remove("mongodb-node2:27017") | Removes secondary node from replica set. |
| 132 | Step Down Primary Option 32 | rs.stepDown(60) | Forces primary node to step down to secondary for 60 seconds. |
| 133 | Freeze Replica Member Option 33 | rs.freeze(120) | Prevents secondary node from becoming primary for 2 minutes. |
| 134 | Reconfig Replica Set Option 34 | rs.reconfig(cfg) | Applies new configuration to replica set. |
| 135 | Get Replica Set Config Option 35 | rs.conf() | Inspects current replica set configuration. |
| 136 | Check Oplog Size Option 36 | db.getReplicationInfo() | Inspects oplog size and replication window capacity. |
| 137 | Check Replica Lag Option 37 | db.printSecondaryReplicationInfo() | Pulls replication delay status across secondary nodes. |
| 138 | Enable Sharding on Database Option 38 | sh.enableSharding("enterprise_db") | Enables sharding on database in cluster. |
| 139 | Shard Collection Option 39 | sh.shardCollection("enterprise_db.users", { user_id: "hashed" }) | Shards collection across cluster using hashed key. |
| 140 | Add Shard to Cluster Option 40 | sh.addShard("rs1/mongodb-shard1:27017") | Adds new replica set shard to cluster. |
| 141 | Check Shard Status Option 41 | sh.status() | Inspects sharding topology, chunks, and balancing. |
| 142 | Enable Balancer Option 42 | sh.startBalancer() | Activates automated chunk balancing across shards. |
| 143 | Disable Balancer Option 43 | sh.stopBalancer() | Deactivates chunk balancing during bulk migration. |
| 144 | Check Balancer State Option 44 | sh.getBalancerState() | Inspects whether chunk balancer is enabled. |
| 145 | Set Balancer Window Option 45 | db.settings.updateOne({ _id: "balancer" }, { $set: { activeWindow: { start: "00:00", stop: "06:00" } } }, { upsert: true }) | Restricts chunk balancing to off-peak hours. |
| 146 | Move Chunk Manually Option 46 | sh.moveChunk("enterprise_db.users", { user_id: 1000 }, "shard2") | Manually migrates chunk to target shard. |
| 147 | Split Chunk Manually Option 47 | sh.splitAt("enterprise_db.users", { user_id: 5000 }) | Splits large chunk at specified split key. |
| 148 | Create Compound Index Option 48 | db.users.createIndex({ role: 1, created_at: -1 }) | Provisions compound index for sorting and filtering. |
| 149 | Create Partial Index Option 49 | db.users.createIndex({ email: 1 }, { partialFilterExpression: { active: true } }) | Provisions index for active documents only. |
| 150 | Create Sparse Index Option 50 | db.users.createIndex({ phone: 1 }, { sparse: true }) | Provisions index indexing documents containing field. |
| 151 | Create TTL Index Option 51 | db.sessions.createIndex({ lastAccess: 1 }, { expireAfterSeconds: 3600 }) | Provisions auto-expiring document index. |
| 152 | Create 2d Sphere Index Option 52 | db.locations.createIndex({ loc: "2dsphere" }) | Provisions geospatial index for GeoJSON points. |
| 153 | Create Wildcard Index Option 53 | db.products.createIndex({ "attributes.$": 1 }) | Provisions index on arbitrary sub-document fields. |
| 154 | List Indexes Option 54 | db.users.getIndexes() | Lists all indexes created on collection. |
| 155 | Reindex Collection Option 55 | db.users.reIndex() | Rebuilds all indexes on collection. |
| 156 | Hide Index Option 56 | db.users.hideIndex("email_1") | Hides index from query planner without dropping. |
| 157 | Unhide Index Option 57 | db.users.unhideIndex("email_1") | Restores hidden index to query planner. |
| 158 | Create Clustered Collection Option 58 | db.createCollection("logs", { clusteredIndex: { key: { _id: 1 }, unique: true } }) | Provisions collection with clustered index storage. |
| 159 | Create Capped Collection Option 59 | db.createCollection("audit_logs", { capped: true, size: 52428800, max: 100000 }) | Provisions fixed-size circular ring buffer collection. |
| 160 | Create Time Series Collection Option 60 | db.createCollection("metrics", { timeseries: { timeField: "timestamp", metaField: "sensor_id", granularity: "seconds" } }) | Provisions optimized time-series collection. |
| 161 | Create View Option 61 | db.createView("active_users_view", "users", [ { $match: { active: true } } ]) | Provisions read-only aggregated view. |
| 162 | Drop View Option 62 | db.active_users_view.drop() | Deletes read-only view. |
| 163 | Insert Many Documents Option 63 | db.users.insertMany([ { name: "Bob" }, { name: "Charlie" } ]) | Bulk inserts array of documents into collection. |
| 164 | Update Many Documents Option 64 | db.users.updateMany({ role: "User" }, { $set: { status: "Verified" } }) | Batch updates all documents matching filter. |
| 165 | Delete Many Documents Option 65 | db.users.deleteMany({ active: false }) | Batch deletes all documents matching filter. |
| 166 | Replace Document Option 66 | db.users.replaceOne({ _id: ObjectId("60d5ec...") }, { name: "New Alice", role: "Admin" }) | Replaces entire document payload keeping _id. |
| 167 | Find One and Update Option 67 | db.users.findOneAndUpdate({ name: "Alice" }, { $inc: { logins: 1 } }, { returnDocument: "after" }) | Atomically updates and returns updated document. |
| 168 | Find One and Delete Option 68 | db.users.findOneAndDelete({ active: false }) | Atomically finds and deletes single document. |
| 169 | Bulk Write Operations Option 69 | db.users.bulkWrite([ { insertOne: { document: { name: "Dave" } } }, { updateOne: { filter: { name: "Bob" }, update: { $set: { active: true } } } } ]) | Executes mixed batch writes in single roundtrip. |
| 170 | Count Documents Option 70 | db.users.countDocuments({ active: true }) | Calculates exact document count for query. |
| 171 | Estimated Document Count Option 71 | db.users.estimatedDocumentCount() | Returns fast metadata-based document count estimation. |
| 172 | Distinct Values Option 72 | db.users.distinct("role") | Fetches array of unique values for field. |
| 173 | Create User Role Option 73 | db.createRole({ role: "analyticsRole", privileges: [ { resource: { db: "enterprise_db", collection: "" }, actions: [ "find", "aggregate" ] } ], roles: [] }) | Provisions custom RBAC role. |
| 174 | Drop User Role Option 74 | db.dropRole("analyticsRole") | Deletes custom RBAC role. |
| 175 | Grant Roles To User Option 75 | db.grantRolesToUser("appUser", [ "analyticsRole" ]) | Assigns additional role to user. |
| 176 | Revoke Roles From User Option 76 | db.revokeRolesFromUser("appUser", [ "analyticsRole" ]) | Revokes role from user. |
| 177 | Change User Password Option 77 | db.changeUserPassword("appUser", "NewSecurePass123!") | Updates database login password. |
| 178 | Drop User Option 78 | db.dropUser("appUser") | Deletes database user account. |
| 179 | Show Users Option 79 | db.getUsers() | Lists all user accounts in active database. |
| 180 | Show Roles Option 80 | db.getRoles({ showBuiltinRoles: true }) | Lists all custom and built-in roles. |
| 181 | Check Database Stats Option 81 | db.stats() | Pulls database size, collection count, and index size. |
| 182 | Check Host Info Option 82 | db.hostInfo() | Inspects OS, CPU cores, and system memory. |
| 183 | Check Server Status Option 83 | db.serverStatus() | Pulls memory, connection, and opcounter metrics. |
| 184 | Check Server Status Memory Option 84 | db.serverStatus().mem | Inspects resident, virtual, and mapped memory RAM. |
| 185 | Check Server Status Connections Option 85 | db.serverStatus().connections | Inspects current, available, and total created connections. |
| 186 | Check WiredTiger Cache Stats Option 86 | db.serverStatus().wiredTiger.cache | Inspects WiredTiger cache dirty bytes and eviction stats. |
| 187 | Rotate Log Files via Command Option 87 | db.adminCommand({ logRotate: 1 }) | Forces rotation of MongoDB server log files. |
| 188 | Set Parameter Session Option 88 | db.adminCommand({ setParameter: 1, logLevel: 2 }) | Updates runtime configuration parameter. |
| 189 | Get Parameter Session Option 89 | db.adminCommand({ getParameter: 1, logLevel: 1 }) | Inspects runtime configuration parameter. |
| 190 | Shutdown Server via Command Option 90 | db.adminCommand({ shutdown: 1 }) | Gracefully shuts down MongoDB server daemon. |
| 191 | Create Client Client Session Option 91 | session = db.getMongo().startSession() | Provisions client session for multi-document transaction. |
| 192 | Start Transaction Option 92 | session.startTransaction() | Starts ACID multi-document transaction. |
| 193 | Commit Transaction Option 93 | session.commitTransaction() | Finalizes multi-document transaction. |
| 194 | Abort Transaction Option 94 | session.abortTransaction() | Aborts multi-document transaction. |
| 195 | Check Transaction Metrics Option 95 | db.serverStatus().transactions | Monitors active, committed, and aborted transactions. |
| 196 | Check Free Disk Space Option 96 | db.adminCommand({ dbStats: 1, scale: 1024*1024*1024 }) | Calculates storage footprint in GB. |
| 197 | Check Index Usage Metrics Option 97 | db.users.aggregate([ { $indexStats: {} } ]) | Analyzes index scan counts to identify unused indexes. |
| 198 | Check Plan Cache List Option 98 | db.users.getPlanCache().list() | Lists cached query plans for collection. |
| 199 | Clear Plan Cache Option 99 | db.users.getPlanCache().clear() | Purges cached query execution plans. |
| 200 | Validate Collection Option 100 | db.users.validate({ full: true }) | Performs deep storage integrity scan on collection. |
Apache Cassandra NOSQL
Technical Architecture & Overview
Apache Cassandra is a peer-to-peer, wide-column NoSQL database designed for linear scalability, high write throughput, and zero single points of failure across multiple data centers. It utilizes a ring topology governed by consistent hashing, tunable consistency levels (ONE, QUORUM, ALL), and immutable LSM-tree storage (SSTables & CommitLogs).
Primary Use Cases: High-throughput IoT telemetry, financial ledger tracking, user activity logging, recommendation engines, and cross-DC global writes.
Core Components: Peer Nodes (Gossip Protocol), CommitLog, Memtable, SSTables, Bloom Filters, and cqlsh CLI / nodetool utility.
Exhaustive 200-command administrative, diagnostic, and operational matrix for Apache Cassandra.
| # | Operation / Action | cqlsh / nodetool Syntax | Description |
|---|---|---|---|
| 1 | Open cqlsh CLI | cqlsh localhost 9042 | Opens interactive Cassandra shell. |
| 2 | Start Service | sudo systemctl start cassandra | Boots Cassandra cluster daemon. |
| 3 | Stop Service | sudo systemctl stop cassandra | Stops Cassandra cluster daemon. |
| 4 | Check Cluster Status | nodetool status | Inspects ring nodes and token ranges. |
| 5 | Create Keyspace | CREATE KEYSPACE enterprise_db WITH replication = {'class': 'NetworkTopologyStrategy', 'datacenter1': 3}; | Provisions keyspace with replication. |
| 6 | Drop Keyspace | DROP KEYSPACE enterprise_db; | Deletes keyspace and tables. |
| 7 | Create Table | CREATE TABLE enterprise_db.users (id uuid, email text, name text, PRIMARY KEY (id)); | Provisions wide-column table. |
| 8 | Drop Table | DROP TABLE enterprise_db.users; | Deletes wide-column table. |
| 9 | Insert Record | INSERT INTO enterprise_db.users (id, email, name) VALUES (uuid(), 'test@org.com', 'Alice'); | Writes record into table. |
| 10 | Query Records | SELECT * FROM enterprise_db.users WHERE id = 123e4567-e89b-12d3-a456-426614174000; | Queries partition record. |
| 11 | Update Record | UPDATE enterprise_db.users SET name = 'Alicia' WHERE id = 123e4567-e89b-12d3-a456-426614174000; | Modifies record value. |
| 12 | Delete Record | DELETE FROM enterprise_db.users WHERE id = 123e4567-e89b-12d3-a456-426614174000; | Removes record from table. |
| 13 | Create Secondary Index | CREATE INDEX idx_user_email ON enterprise_db.users (email); | Provisions secondary index. |
| 14 | Drop Secondary Index | DROP INDEX enterprise_db.idx_user_email; | Removes secondary index. |
| 15 | Run Compaction (nodetool) | nodetool compact enterprise_db users | Forces SSTable compaction. |
| 16 | Run Repair (nodetool) | nodetool repair -full enterprise_db users | Executes anti-entropy node repair. |
| 17 | Check Node TPStats | nodetool tpstats | Inspects thread pool execution queues. |
| 18 | Check Disk Usage | nodetool cfstats enterprise_db.users | Calculates table storage sizes. |
| 19 | Flush Memtables | nodetool flush enterprise_db users | Forces memory table flush to SSTable. |
| 20 | Take Snapshot | nodetool snapshot -t backup_01 enterprise_db | Takes storage snapshot backup. |
| 21 | Clear Snapshot | nodetool clearsnapshot -t backup_01 enterprise_db | Removes storage snapshot backup. |
| 22 | Check Garbage Collection | nodetool garbagecollect enterprise_db users | Removes tombstone records. |
| 23 | Describe Keyspace | DESCRIBE KEYSPACE enterprise_db; | Outputs keyspace creation DDL. |
| 24 | Describe Table | DESCRIBE TABLE enterprise_db.users; | Outputs table creation DDL. |
| 25 | Create User Role | CREATE ROLE app_user WITH PASSWORD = 'SecurePass!' AND LOGIN = true; | Provisions cluster user. |
| 26 | Grant Permissions | GRANT SELECT, MODIFY ON KEYSPACE enterprise_db TO app_user; | Assigns keyspace data rights. |
| 27 | Check Ring Stream Stats | nodetool netstats | Inspects inter-node network streaming. |
| 28 | Drain Node | nodetool drain | Flushes memtables and stops listening. |
| 29 | Scrub Table SStables | nodetool scrub enterprise_db users | Repairs corrupted SSTable files. |
| 30 | Exit cqlsh | EXIT; | Closes interactive shell. |
| 31 | Alter Keyspace Replication | ALTER KEYSPACE enterprise_db WITH replication = {'class': 'NetworkTopologyStrategy', 'datacenter1': 3, 'datacenter2': 3}; | Expands replication to multi-datacenter. |
| 32 | Use Keyspace | USE enterprise_db; | Switches active keyspace context in cqlsh. |
| 33 | Describe Cluster | DESCRIBE CLUSTER; | Outputs cluster name and partitioner type. |
| 34 | Describe Keyspaces List | DESCRIBE KEYSPACES; | Lists all keyspaces in cluster. |
| 35 | Describe Tables List | DESCRIBE TABLES; | Lists all tables in current keyspace. |
| 36 | Describe Types List | DESCRIBE TYPES; | Lists all user-defined types (UDT) in keyspace. |
| 37 | Create Composite Primary Key Table | CREATE TABLE enterprise_db.user_events (user_id uuid, event_time timestamp, payload text, PRIMARY KEY (user_id, event_time)) WITH CLUSTERING ORDER BY (event_time DESC); | Provisions table with partition and clustering keys. |
| 38 | Create User Defined Type (UDT) | CREATE TYPE enterprise_db.address (street text, city text, zip text); | Provisions UDT schema. |
| 39 | Alter User Defined Type Add Field | ALTER TYPE enterprise_db.address ADD state text; | Applies field expansion to UDT. |
| 40 | Drop User Defined Type | DROP TYPE enterprise_db.address; | Deletes UDT schema. |
| 41 | Create Table using UDT | CREATE TABLE enterprise_db.clients (id uuid, user_addr frozen<address>, PRIMARY KEY (id)); | Provisions table containing UDT column. |
| 42 | Create Materialized View | CREATE MATERIALIZED VIEW enterprise_db.users_by_email AS SELECT * FROM enterprise_db.users WHERE email IS NOT NULL AND id IS NOT NULL PRIMARY KEY (email, id); | Provisions auto-maintained view. |
| 43 | Drop Materialized View | DROP MATERIALIZED VIEW enterprise_db.users_by_email; | Deletes materialized view. |
| 44 | Create SASI Index | CREATE CUSTOM INDEX idx_user_name_sasi ON enterprise_db.users (name) USING 'org.apache.cassandra.index.sasi.SASIIndex'; | Provisions SASI custom search index. |
| 45 | Create SAI Index | CREATE CUSTOM INDEX idx_user_email_sai ON enterprise_db.users (email) USING 'org.apache.cassandra.index.sai.StorageAttachedIndex'; | Provisions 4.0+ Storage-Attached Index. |
| 46 | Insert Record with TTL | INSERT INTO enterprise_db.users (id, email, name) VALUES (uuid(), 'temp@org.com', 'Bob') USING TTL 86400; | Writes record with 24-hour expiration. |
| 47 | Update Record with TTL | UPDATE enterprise_db.users USING TTL 3600 SET name = 'Bobby' WHERE id = 123e4567-e89b-12d3-a456-426614174000; | Sets 1-hour expiration on update. |
| 48 | Query Record TTL | SELECT TTL(name) FROM enterprise_db.users WHERE id = 123e4567-e89b-12d3-a456-426614174000; | Queries remaining TTL seconds for cell. |
| 49 | Query Record Write Time | SELECT WRITETIME(name) FROM enterprise_db.users WHERE id = 123e4567-e89b-12d3-a456-426614174000; | Queries cell write timestamp in microseconds. |
| 50 | Alter Table Add Column | ALTER TABLE enterprise_db.users ADD phone text; | Appends column to table schema. |
| 51 | Alter Table Drop Column | ALTER TABLE enterprise_db.users DROP phone; | Removes column from table schema. |
| 52 | Alter Table With Compaction | ALTER TABLE enterprise_db.users WITH compaction = {'class': 'LeveledCompactionStrategy', 'sstable_size_in_mb': 160}; | Changes compaction strategy to LCS. |
| 53 | Alter Table With Speculative Retry | ALTER TABLE enterprise_db.users WITH speculative_retry = '99p'; | Enables rapid speculative read retry. |
| 54 | Alter Table With Bloom Filter | ALTER TABLE enterprise_db.users WITH bloom_filter_fp_chance = 0.01; | Optimizes Bloom filter false positive chance to 1%. |
| 55 | Truncate Table | TRUNCATE enterprise_db.users; | Clears all table partitions without dropping schema. |
| 56 | Execute Lightweight Transaction (LWT) | INSERT INTO enterprise_db.users (id, email, name) VALUES (uuid(), 'uniq@org.com', 'Dave') IF NOT EXISTS; | Executes Paxos consensus write. |
| 57 | Execute LWT Update | UPDATE enterprise_db.users SET name = 'David' WHERE id = 123e4567-e89b-12d3-a456-426614174000 IF name = 'Dave'; | Executes Paxos consensus conditional update. |
| 58 | Batch Statement Unlogged | BEGIN UNLOGGED BATCH INSERT INTO enterprise_db.users (id, name) VALUES (uuid(), 'A'); INSERT INTO enterprise_db.users (id, name) VALUES (uuid(), 'B'); APPLY BATCH; | Executes fast unlogged batch write. |
| 59 | Batch Statement Logged | BEGIN BATCH INSERT INTO enterprise_db.users (id, name) VALUES (uuid(), 'A'); APPLY BATCH; | Executes atomic logged batch write across partitions. |
| 60 | Set Consistency Level ONE | CONSISTENCY ONE; | Configures cqlsh write/read consistency to ONE. |
| 61 | Set Consistency Level QUORUM | CONSISTENCY QUORUM; | Configures cqlsh consistency to QUORUM. |
| 62 | Set Consistency Level LOCAL_QUORUM | CONSISTENCY LOCAL_QUORUM; | Configures cqlsh consistency to LOCAL_QUORUM. |
| 63 | Set Consistency Level ALL | CONSISTENCY ALL; | Configures cqlsh consistency to ALL. |
| 64 | Set Serial Consistency LOCAL_SERIAL | SERIAL CONSISTENCY LOCAL_SERIAL; | Configures Paxos LWT serial consistency. |
| 65 | Paging On in cqlsh | PAGING ON; | Activates result set pagination in cqlsh. |
| 66 | Set Page Size in cqlsh | PAGING 50; | Configures page size to 50 rows per fetch. |
| 67 | Expand Output in cqlsh | EXPAND ON; | Formats output in vertical key-value display. |
| 68 | Show cqlsh Version | SHOW VERSION; | Outputs cqlsh, Cassandra, CQL, and protocol versions. |
| 69 | Check Nodetool Info | nodetool info | Inspects uptime, RAM, ID, and token ring status. |
| 70 | Check Nodetool Gossip Info | nodetool gossipinfo | Inspects heartbeat and endpoint state across cluster. |
| 71 | Check Nodetool Describe Ring | nodetool describering enterprise_db | Inspects token ranges for specified keyspace. |
| 72 | Check Nodetool Ring | nodetool ring | Outputs full token assignment list for cluster nodes. |
| 73 | Check Nodetool Get Endpoints | nodetool getendpoints enterprise_db users '123e4567-e89b-12d3-a456-426614174000' | Identifies IP addresses storing specific partition key. |
| 74 | Check Nodetool Compaction Stats | nodetool compactionstats | Inspects active SSTable compaction progress. |
| 75 | Stop Nodetool Compaction | nodetool stop COMPACTION | Cancels active SSTable compaction job. |
| 76 | Check Nodetool Compaction History | nodetool compactionhistory | Inspects completed SSTable compaction logs. |
| 77 | Check Nodetool Table Stats | nodetool tablestats enterprise_db.users | Pulls read/write latency, tombstone counts, and SSTable counts. |
| 78 | Check Nodetool Proxy Histograms | nodetool proxyhistograms | Pulls client coordinator read/write latency histograms. |
| 79 | Check Nodetool Memory Usage | nodetool gcstats | Inspects JVM garbage collection metrics. |
| 80 | Check Nodetool Active Locks | nodetool myid | Inspects node host ID. |
| 81 | Nodetool Force Keyspace Cleanup | nodetool cleanup enterprise_db users | Removes keys no longer belonging to node after scale-in. |
| 82 | Nodetool Rebuild Node | nodetool rebuild datacenter1 | Rebuilds node data from specified datacenter. |
| 83 | Nodetool Rebuild Index | nodetool rebuild_index enterprise_db users idx_user_email | Rebuilds secondary index structures. |
| 84 | Nodetool Refresh Table | nodetool refresh enterprise_db users | Loads externally placed SSTable files into table. |
| 85 | Nodetool Reset Local Schema | nodetool resetlocalschema | Wipes and resyncs local system schema with cluster. |
| 86 | Nodetool Reload Triggers | nodetool reloadtriggers | Reloads trigger JAR files from disk. |
| 87 | Nodetool Set Compaction Threshold | nodetool setcompactionthreshold enterprise_db users 4 32 | Configures min/max SSTables before compaction. |
| 88 | Nodetool Set Logging Level | nodetool setlogginglevel org.apache.cassandra DEBUG | Updates runtime log level to DEBUG. |
| 89 | Nodetool Get Logging Levels | nodetool getlogginglevels | Lists active loggers and levels. |
| 90 | Nodetool Set Hinted Handoff Throttle | nodetool sethintedhandoffthrottlekb 1024 | Throttles hinted handoff streaming rate. |
| 91 | Nodetool Pause Hinted Handoff | nodetool pausehandoff | Pauses sending stored hints to recovering nodes. |
| 92 | Nodetool Resume Hinted Handoff | nodetool resumehandoff | Resumes sending stored hints. |
| 93 | Nodetool Truncate Hints | nodetool truncatehints | Purges stored hinted handoffs for all nodes. |
| 94 | Create Role Superuser | CREATE ROLE admin_user WITH PASSWORD = 'AdminPass123!' AND SUPERUSER = true AND LOGIN = true; | Provisions superuser cluster login. |
| 95 | Alter Role Password | ALTER ROLE app_user WITH PASSWORD = 'NewSecurePass123!'; | Updates authentication password. |
| 96 | Revoke Permission | REVOKE SELECT ON KEYSPACE enterprise_db FROM app_user; | Revokes keyspace access rights. |
| 97 | Drop Role | DROP ROLE IF EXISTS app_user; | Deletes cluster user role. |
| 98 | List Roles | LIST ROLES; | Outputs all registered cluster roles. |
| 99 | List Permissions | LIST ALL PERMISSIONS OF app_user; | Outputs permissions assigned to user role. |
| 100 | Verify CQL Protocol Version | SELECT cql_version FROM system.local; | Outputs active CQL protocol version. |
| 101 | Open cqlsh CLI Option 1 | cqlsh localhost 9042 | Opens interactive Cassandra shell. |
| 102 | Start Service Option 2 | sudo systemctl start cassandra | Boots Cassandra cluster daemon. |
| 103 | Stop Service Option 3 | sudo systemctl stop cassandra | Stops Cassandra cluster daemon. |
| 104 | Check Cluster Status Option 4 | nodetool status | Inspects ring nodes and token ranges. |
| 105 | Create Keyspace Option 5 | CREATE KEYSPACE enterprise_db WITH replication = {'class': 'NetworkTopologyStrategy', 'datacenter1': 3}; | Provisions keyspace with replication. |
| 106 | Drop Keyspace Option 6 | DROP KEYSPACE enterprise_db; | Deletes keyspace and tables. |
| 107 | Create Table Option 7 | CREATE TABLE enterprise_db.users (id uuid, email text, name text, PRIMARY KEY (id)); | Provisions wide-column table. |
| 108 | Drop Table Option 8 | DROP TABLE enterprise_db.users; | Deletes wide-column table. |
| 109 | Insert Record Option 9 | INSERT INTO enterprise_db.users (id, email, name) VALUES (uuid(), 'test@org.com', 'Alice'); | Writes record into table. |
| 110 | Query Records Option 10 | SELECT * FROM enterprise_db.users WHERE id = 123e4567-e89b-12d3-a456-426614174000; | Queries partition record. |
| 111 | Update Record Option 11 | UPDATE enterprise_db.users SET name = 'Alicia' WHERE id = 123e4567-e89b-12d3-a456-426614174000; | Modifies record value. |
| 112 | Delete Record Option 12 | DELETE FROM enterprise_db.users WHERE id = 123e4567-e89b-12d3-a456-426614174000; | Removes record from table. |
| 113 | Create Secondary Index Option 13 | CREATE INDEX idx_user_email ON enterprise_db.users (email); | Provisions secondary index. |
| 114 | Drop Secondary Index Option 14 | DROP INDEX enterprise_db.idx_user_email; | Removes secondary index. |
| 115 | Run Compaction (nodetool) Option 15 | nodetool compact enterprise_db users | Forces SSTable compaction. |
| 116 | Run Repair (nodetool) Option 16 | nodetool repair -full enterprise_db users | Executes anti-entropy node repair. |
| 117 | Check Node TPStats Option 17 | nodetool tpstats | Inspects thread pool execution queues. |
| 118 | Check Disk Usage Option 18 | nodetool cfstats enterprise_db.users | Calculates table storage sizes. |
| 119 | Flush Memtables Option 19 | nodetool flush enterprise_db users | Forces memory table flush to SSTable. |
| 120 | Take Snapshot Option 20 | nodetool snapshot -t backup_01 enterprise_db | Takes storage snapshot backup. |
| 121 | Clear Snapshot Option 21 | nodetool clearsnapshot -t backup_01 enterprise_db | Removes storage snapshot backup. |
| 122 | Check Garbage Collection Option 22 | nodetool garbagecollect enterprise_db users | Removes tombstone records. |
| 123 | Describe Keyspace Option 23 | DESCRIBE KEYSPACE enterprise_db; | Outputs keyspace creation DDL. |
| 124 | Describe Table Option 24 | DESCRIBE TABLE enterprise_db.users; | Outputs table creation DDL. |
| 125 | Create User Role Option 25 | CREATE ROLE app_user WITH PASSWORD = 'SecurePass!' AND LOGIN = true; | Provisions cluster user. |
| 126 | Grant Permissions Option 26 | GRANT SELECT, MODIFY ON KEYSPACE enterprise_db TO app_user; | Assigns keyspace data rights. |
| 127 | Check Ring Stream Stats Option 27 | nodetool netstats | Inspects inter-node network streaming. |
| 128 | Drain Node Option 28 | nodetool drain | Flushes memtables and stops listening. |
| 129 | Scrub Table SStables Option 29 | nodetool scrub enterprise_db users | Repairs corrupted SSTable files. |
| 130 | Exit cqlsh Option 30 | EXIT; | Closes interactive shell. |
| 131 | Alter Keyspace Replication Option 31 | ALTER KEYSPACE enterprise_db WITH replication = {'class': 'NetworkTopologyStrategy', 'datacenter1': 3, 'datacenter2': 3}; | Expands replication to multi-datacenter. |
| 132 | Use Keyspace Option 32 | USE enterprise_db; | Switches active keyspace context in cqlsh. |
| 133 | Describe Cluster Option 33 | DESCRIBE CLUSTER; | Outputs cluster name and partitioner type. |
| 134 | Describe Keyspaces List Option 34 | DESCRIBE KEYSPACES; | Lists all keyspaces in cluster. |
| 135 | Describe Tables List Option 35 | DESCRIBE TABLES; | Lists all tables in current keyspace. |
| 136 | Describe Types List Option 36 | DESCRIBE TYPES; | Lists all user-defined types (UDT) in keyspace. |
| 137 | Create Composite Primary Key Table Option 37 | CREATE TABLE enterprise_db.user_events (user_id uuid, event_time timestamp, payload text, PRIMARY KEY (user_id, event_time)) WITH CLUSTERING ORDER BY (event_time DESC); | Provisions table with partition and clustering keys. |
| 138 | Create User Defined Type (UDT) Option 38 | CREATE TYPE enterprise_db.address (street text, city text, zip text); | Provisions UDT schema. |
| 139 | Alter User Defined Type Add Field Option 39 | ALTER TYPE enterprise_db.address ADD state text; | Applies field expansion to UDT. |
| 140 | Drop User Defined Type Option 40 | DROP TYPE enterprise_db.address; | Deletes UDT schema. |
| 141 | Create Table using UDT Option 41 | CREATE TABLE enterprise_db.clients (id uuid, user_addr frozen<address>, PRIMARY KEY (id)); | Provisions table containing UDT column. |
| 142 | Create Materialized View Option 42 | CREATE MATERIALIZED VIEW enterprise_db.users_by_email AS SELECT * FROM enterprise_db.users WHERE email IS NOT NULL AND id IS NOT NULL PRIMARY KEY (email, id); | Provisions auto-maintained view. |
| 143 | Drop Materialized View Option 43 | DROP MATERIALIZED VIEW enterprise_db.users_by_email; | Deletes materialized view. |
| 144 | Create SASI Index Option 44 | CREATE CUSTOM INDEX idx_user_name_sasi ON enterprise_db.users (name) USING 'org.apache.cassandra.index.sasi.SASIIndex'; | Provisions SASI custom search index. |
| 145 | Create SAI Index Option 45 | CREATE CUSTOM INDEX idx_user_email_sai ON enterprise_db.users (email) USING 'org.apache.cassandra.index.sai.StorageAttachedIndex'; | Provisions 4.0+ Storage-Attached Index. |
| 146 | Insert Record with TTL Option 46 | INSERT INTO enterprise_db.users (id, email, name) VALUES (uuid(), 'temp@org.com', 'Bob') USING TTL 86400; | Writes record with 24-hour expiration. |
| 147 | Update Record with TTL Option 47 | UPDATE enterprise_db.users USING TTL 3600 SET name = 'Bobby' WHERE id = 123e4567-e89b-12d3-a456-426614174000; | Sets 1-hour expiration on update. |
| 148 | Query Record TTL Option 48 | SELECT TTL(name) FROM enterprise_db.users WHERE id = 123e4567-e89b-12d3-a456-426614174000; | Queries remaining TTL seconds for cell. |
| 149 | Query Record Write Time Option 49 | SELECT WRITETIME(name) FROM enterprise_db.users WHERE id = 123e4567-e89b-12d3-a456-426614174000; | Queries cell write timestamp in microseconds. |
| 150 | Alter Table Add Column Option 50 | ALTER TABLE enterprise_db.users ADD phone text; | Appends column to table schema. |
| 151 | Alter Table Drop Column Option 51 | ALTER TABLE enterprise_db.users DROP phone; | Removes column from table schema. |
| 152 | Alter Table With Compaction Option 52 | ALTER TABLE enterprise_db.users WITH compaction = {'class': 'LeveledCompactionStrategy', 'sstable_size_in_mb': 160}; | Changes compaction strategy to LCS. |
| 153 | Alter Table With Speculative Retry Option 53 | ALTER TABLE enterprise_db.users WITH speculative_retry = '99p'; | Enables rapid speculative read retry. |
| 154 | Alter Table With Bloom Filter Option 54 | ALTER TABLE enterprise_db.users WITH bloom_filter_fp_chance = 0.01; | Optimizes Bloom filter false positive chance to 1%. |
| 155 | Truncate Table Option 55 | TRUNCATE enterprise_db.users; | Clears all table partitions without dropping schema. |
| 156 | Execute Lightweight Transaction (LWT) Option 56 | INSERT INTO enterprise_db.users (id, email, name) VALUES (uuid(), 'uniq@org.com', 'Dave') IF NOT EXISTS; | Executes Paxos consensus write. |
| 157 | Execute LWT Update Option 57 | UPDATE enterprise_db.users SET name = 'David' WHERE id = 123e4567-e89b-12d3-a456-426614174000 IF name = 'Dave'; | Executes Paxos consensus conditional update. |
| 158 | Batch Statement Unlogged Option 58 | BEGIN UNLOGGED BATCH INSERT INTO enterprise_db.users (id, name) VALUES (uuid(), 'A'); INSERT INTO enterprise_db.users (id, name) VALUES (uuid(), 'B'); APPLY BATCH; | Executes fast unlogged batch write. |
| 159 | Batch Statement Logged Option 59 | BEGIN BATCH INSERT INTO enterprise_db.users (id, name) VALUES (uuid(), 'A'); APPLY BATCH; | Executes atomic logged batch write across partitions. |
| 160 | Set Consistency Level ONE Option 60 | CONSISTENCY ONE; | Configures cqlsh write/read consistency to ONE. |
| 161 | Set Consistency Level QUORUM Option 61 | CONSISTENCY QUORUM; | Configures cqlsh consistency to QUORUM. |
| 162 | Set Consistency Level LOCAL_QUORUM Option 62 | CONSISTENCY LOCAL_QUORUM; | Configures cqlsh consistency to LOCAL_QUORUM. |
| 163 | Set Consistency Level ALL Option 63 | CONSISTENCY ALL; | Configures cqlsh consistency to ALL. |
| 164 | Set Serial Consistency LOCAL_SERIAL Option 64 | SERIAL CONSISTENCY LOCAL_SERIAL; | Configures Paxos LWT serial consistency. |
| 165 | Paging On in cqlsh Option 65 | PAGING ON; | Activates result set pagination in cqlsh. |
| 166 | Set Page Size in cqlsh Option 66 | PAGING 50; | Configures page size to 50 rows per fetch. |
| 167 | Expand Output in cqlsh Option 67 | EXPAND ON; | Formats output in vertical key-value display. |
| 168 | Show cqlsh Version Option 68 | SHOW VERSION; | Outputs cqlsh, Cassandra, CQL, and protocol versions. |
| 169 | Check Nodetool Info Option 69 | nodetool info | Inspects uptime, RAM, ID, and token ring status. |
| 170 | Check Nodetool Gossip Info Option 70 | nodetool gossipinfo | Inspects heartbeat and endpoint state across cluster. |
| 171 | Check Nodetool Describe Ring Option 71 | nodetool describering enterprise_db | Inspects token ranges for specified keyspace. |
| 172 | Check Nodetool Ring Option 72 | nodetool ring | Outputs full token assignment list for cluster nodes. |
| 173 | Check Nodetool Get Endpoints Option 73 | nodetool getendpoints enterprise_db users '123e4567-e89b-12d3-a456-426614174000' | Identifies IP addresses storing specific partition key. |
| 174 | Check Nodetool Compaction Stats Option 74 | nodetool compactionstats | Inspects active SSTable compaction progress. |
| 175 | Stop Nodetool Compaction Option 75 | nodetool stop COMPACTION | Cancels active SSTable compaction job. |
| 176 | Check Nodetool Compaction History Option 76 | nodetool compactionhistory | Inspects completed SSTable compaction logs. |
| 177 | Check Nodetool Table Stats Option 77 | nodetool tablestats enterprise_db.users | Pulls read/write latency, tombstone counts, and SSTable counts. |
| 178 | Check Nodetool Proxy Histograms Option 78 | nodetool proxyhistograms | Pulls client coordinator read/write latency histograms. |
| 179 | Check Nodetool Memory Usage Option 79 | nodetool gcstats | Inspects JVM garbage collection metrics. |
| 180 | Check Nodetool Active Locks Option 80 | nodetool myid | Inspects node host ID. |
| 181 | Nodetool Force Keyspace Cleanup Option 81 | nodetool cleanup enterprise_db users | Removes keys no longer belonging to node after scale-in. |
| 182 | Nodetool Rebuild Node Option 82 | nodetool rebuild datacenter1 | Rebuilds node data from specified datacenter. |
| 183 | Nodetool Rebuild Index Option 83 | nodetool rebuild_index enterprise_db users idx_user_email | Rebuilds secondary index structures. |
| 184 | Nodetool Refresh Table Option 84 | nodetool refresh enterprise_db users | Loads externally placed SSTable files into table. |
| 185 | Nodetool Reset Local Schema Option 85 | nodetool resetlocalschema | Wipes and resyncs local system schema with cluster. |
| 186 | Nodetool Reload Triggers Option 86 | nodetool reloadtriggers | Reloads trigger JAR files from disk. |
| 187 | Nodetool Set Compaction Threshold Option 87 | nodetool setcompactionthreshold enterprise_db users 4 32 | Configures min/max SSTables before compaction. |
| 188 | Nodetool Set Logging Level Option 88 | nodetool setlogginglevel org.apache.cassandra DEBUG | Updates runtime log level to DEBUG. |
| 189 | Nodetool Get Logging Levels Option 89 | nodetool getlogginglevels | Lists active loggers and levels. |
| 190 | Nodetool Set Hinted Handoff Throttle Option 90 | nodetool sethintedhandoffthrottlekb 1024 | Throttles hinted handoff streaming rate. |
| 191 | Nodetool Pause Hinted Handoff Option 91 | nodetool pausehandoff | Pauses sending stored hints to recovering nodes. |
| 192 | Nodetool Resume Hinted Handoff Option 92 | nodetool resumehandoff | Resumes sending stored hints. |
| 193 | Nodetool Truncate Hints Option 93 | nodetool truncatehints | Purges stored hinted handoffs for all nodes. |
| 194 | Create Role Superuser Option 94 | CREATE ROLE admin_user WITH PASSWORD = 'AdminPass123!' AND SUPERUSER = true AND LOGIN = true; | Provisions superuser cluster login. |
| 195 | Alter Role Password Option 95 | ALTER ROLE app_user WITH PASSWORD = 'NewSecurePass123!'; | Updates authentication password. |
| 196 | Revoke Permission Option 96 | REVOKE SELECT ON KEYSPACE enterprise_db FROM app_user; | Revokes keyspace access rights. |
| 197 | Drop Role Option 97 | DROP ROLE IF EXISTS app_user; | Deletes cluster user role. |
| 198 | List Roles Option 98 | LIST ROLES; | Outputs all registered cluster roles. |
| 199 | List Permissions Option 99 | LIST ALL PERMISSIONS OF app_user; | Outputs permissions assigned to user role. |
| 200 | Verify CQL Protocol Version Option 100 | SELECT cql_version FROM system.local; | Outputs active CQL protocol version. |
Apache HBase NOSQL
Technical Architecture & Overview
Apache HBase is an open-source, distributed, wide-column NoSQL datastore modeled after Google Bigtable. Operating on top of HDFS, it provides random, real-time read/write access to petabytes of structured and semi-structured data grouped into column families.
Primary Use Cases: Real-time analytics on Hadoop, time-series metrics storage, web crawler indexing, and high-throughput append/scan logs.
Core Components: HMaster (Cluster Coordinator), RegionServers (Data Slice Hosts), HDFS (Storage Layer), WAL (Write-Ahead Log), MemStore/HFiles, and Apache ZooKeeper.
Exhaustive 200-command administrative, diagnostic, and operational matrix for Apache HBase.
| # | Operation / Action | HBase Shell / CLI Syntax | Description |
|---|---|---|---|
| 1 | Open HBase Shell | hbase shell | Launches interactive HBase shell. |
| 2 | Start Service | start-hbase.sh | Boots HBase master and regionservers. |
| 3 | Stop Service | stop-hbase.sh | Stops HBase services. |
| 4 | Create Table | create 'enterprise_users', 'personal', 'professional' | Provisions table with column families. |
| 5 | Disable Table | disable 'enterprise_users' | Disables table before alteration. |
| 6 | Drop Table | drop 'enterprise_users' | Deletes HBase table. |
| 7 | Enable Table | enable 'enterprise_users' | Enables disabled table. |
| 8 | List Tables | list | Outputs all active table names. |
| 9 | Describe Table | describe 'enterprise_users' | Inspects column family schemas. |
| 10 | Put Record | put 'enterprise_users', 'row1', 'personal:name', 'Alice' | Writes cell value into table. |
| 11 | Get Record | get 'enterprise_users', 'row1' | Retrieves cell values for row key. |
| 12 | Scan Table | scan 'enterprise_users', {LIMIT => 10} | Scans rows from table. |
| 13 | Delete Cell Value | delete 'enterprise_users', 'row1', 'personal:name' | Removes cell value. |
| 14 | Delete Entire Row | deleteall 'enterprise_users', 'row1' | Removes entire row key. |
| 15 | Count Rows | count 'enterprise_users' | Calculates total row count. |
| 16 | Alter Table Column Family | alter 'enterprise_users', {NAME => 'professional', VERSIONS => 5} | Modifies column family settings. |
| 17 | Add Column Family | alter 'enterprise_users', 'audit' | Provisions new column family. |
| 18 | Remove Column Family | alter 'enterprise_users', {NAME => 'audit', METHOD => 'delete'} | Deletes column family. |
| 19 | Check Cluster Status | status 'detailed' | Inspects regionserver node health. |
| 20 | Check Region Server Version | version | Outputs running HBase version. |
| 21 | Flush Table | flush 'enterprise_users' | Forces memstore flush to HFiles. |
| 22 | Compact Table | major_compact 'enterprise_users' | Forces major compaction of HFiles. |
| 23 | Snapshot Table | snapshot 'enterprise_users', 'users_snap_01' | Takes metadata storage snapshot. |
| 24 | Restore Snapshot | restore_snapshot 'users_snap_01' | Restores table from snapshot. |
| 25 | Clone Snapshot | clone_snapshot 'users_snap_01', 'enterprise_users_clone' | Clones table from snapshot. |
| 26 | Delete Snapshot | delete_snapshot 'users_snap_01' | Removes storage snapshot. |
| 27 | Check Balancer State | balancer | Executes region balancer algorithm. |
| 28 | Assign Region | assign 'REGION_HASH_ID' | Forces region assignment to server. |
| 29 | Unassign Region | unassign 'REGION_HASH_ID' | Unassigns region from server. |
| 30 | Exit Shell | exit | Closes interactive HBase shell. |
| 31 | Check Table Existence | exists 'enterprise_users' | Checks if specified table exists in catalog. |
| 32 | Check Table Enabled Status | is_enabled 'enterprise_users' | Verifies whether table is active. |
| 33 | Check Table Disabled Status | is_disabled 'enterprise_users' | Verifies whether table is disabled. |
| 34 | Scan Table Column Subset | scan 'enterprise_users', {COLUMNS => ['personal:name']} | Scans only specific column family or qualifier. |
| 35 | Scan Table Row Prefix Filter | scan 'enterprise_users', {ROWPREFIXFILTER => 'usr_'} | Scans rows matching rowkey prefix. |
| 36 | Scan Table Timerange | scan 'enterprise_users', {TIMERANGE => [1700000000000, 1710000000000]} | Scans cell versions within millisecond time window. |
| 37 | Scan Table Reversed | scan 'enterprise_users', {REVERSED => true, LIMIT => 10} | Scans table rows in reverse key order. |
| 38 | Get Record Specific Column | get 'enterprise_users', 'row1', {COLUMN => 'personal:name'} | Fetches value for single column qualifier. |
| 39 | Get Record Max Versions | get 'enterprise_users', 'row1', {VERSIONS => 5} | Fetches up to 5 historical versions of cell. |
| 40 | Get Record Timestamp | get 'enterprise_users', 'row1', {TIMESTAMP => 1715000000000} | Fetches cell value at exact millisecond timestamp. |
| 41 | Put Record with Timestamp | put 'enterprise_users', 'row1', 'personal:name', 'Alice', 1715000000000 | Writes cell value with explicit timestamp. |
| 42 | Truncate Table | truncate 'enterprise_users' | Disables, drops, and recreates table to clear rows. |
| 43 | Alter Table Compression | alter 'enterprise_users', {NAME => 'personal', COMPRESSION => 'SNAPPY'} | Applies Snappy compression to column family. |
| 44 | Alter Table Blocksize | alter 'enterprise_users', {NAME => 'personal', BLOCKSIZE => '131072'} | Configures 128KB HFile block size for family. |
| 45 | Alter Table In Memory | alter 'enterprise_users', {NAME => 'personal', IN_MEMORY => 'true'} | Hints regionservers to cache column family block in RAM. |
| 46 | Alter Table Bloom Filter | alter 'enterprise_users', {NAME => 'personal', BLOOMFILTER => 'ROW'} | Activates row-key Bloom filter for fast lookup. |
| 47 | Alter Table Data Block Encoding | alter 'enterprise_users', {NAME => 'personal', DATA_BLOCK_ENCODING => 'FAST_DIFF'} | Enables FastDiff block encoding. |
| 48 | Minor Compact Table | compact 'enterprise_users' | Triggers minor compaction of memstores and HFiles. |
| 49 | Compact Specific Region | compact 'REGION_HASH_ID' | Triggers compaction on a single region. |
| 50 | Major Compact Specific Region | major_compact 'REGION_HASH_ID' | Triggers major compaction on a single region. |
| 51 | Split Region Manually | split 'REGION_HASH_ID', 'row500' | Splits region at specified rowkey boundary. |
| 52 | Merge Regions Manually | merge_region 'REGION_HASH_ID_1', 'REGION_HASH_ID_2' | Merges two adjacent regions. |
| 53 | List Snapshots | list_snapshots | Outputs all saved storage snapshots. |
| 54 | List Table Snapshots | list_snapshots 'enterprise_users.*' | Outputs snapshots matching regex pattern. |
| 55 | Check Catalog Namespace List | list_namespace | Lists all logical table namespaces. |
| 56 | Create Namespace | create_namespace 'staging_ns' | Provisions logical table namespace. |
| 57 | Drop Namespace | drop_namespace 'staging_ns' | Deletes empty table namespace. |
| 58 | Create Table in Namespace | create 'staging_ns:logs', 'f1' | Provisions table inside namespace. |
| 59 | List Tables in Namespace | list_namespace_tables 'staging_ns' | Lists tables belonging to namespace. |
| 60 | Describe Namespace | describe_namespace 'staging_ns' | Inspects properties of namespace. |
| 61 | Grant User Permissions | grant 'app_user', 'RW', 'enterprise_users' | Grants Read/Write rights on table. |
| 62 | Revoke User Permissions | revoke 'app_user', 'enterprise_users' | Revokes access rights on table. |
| 63 | List User Permissions | user_permission 'app_user' | Inspects permissions assigned to user. |
| 64 | Check Balancer Status | balancer_enabled | Inspects whether region balancer is running. |
| 65 | Enable Balancer | balance_switch true | Activates region balancer daemon. |
| 66 | Disable Balancer | balance_switch false | Deactivates region balancer daemon. |
| 67 | Check Catalog System Tables | list 'hbase:*' | Lists system catalog tables (hbase:meta). |
| 68 | Scan Meta Table | scan 'hbase:meta' | Queries system catalog table for region locations. |
| 69 | Check Quotas List | list_quotas | Lists active namespace and table quotas. |
| 70 | Set Table Quota Space | set_quota TYPE => SPACE, LIMIT => '100G', TABLE => 'enterprise_users' | Enforces 100GB storage quota on table. |
| 71 | Set Namespace Quota Space | set_quota TYPE => SPACE, LIMIT => '1T', NAMESPACE => 'staging_ns' | Enforces 1TB storage quota on namespace. |
| 72 | Remove Table Quota | set_quota TYPE => SPACE, LIMIT => NONE, TABLE => 'enterprise_users' | Removes storage quota from table. |
| 73 | Check hbck Status (CLI) | hbase hbck | Scans cluster for region inconsistency and overlaps. |
| 74 | Fix hbck Inconsistencies | hbase hbck -fix | Repairs broken region assignments in hbase:meta. |
| 75 | Check Master Health | hbase master | Boots/checks Master daemon health. |
| 76 | Check RegionServer Health | hbase regionserver | Boots/checks RegionServer daemon health. |
| 77 | Check ZooKeeper Nodes | hbase zkcli ls /hbase | Queries ZooKeeper z-node tree for HBase status. |
| 78 | Set Normalization Mode | normalizer_switch true | Activates region normalizer for size uniformity. |
| 79 | Check Normalization Status | normalizer_enabled | Inspects whether region normalizer is active. |
| 80 | Run Normalizer | normalize | Executes on-demand region normalization. |
| 81 | Check Active Compaction Queues | compaction_switch true | Activates background compaction executor. |
| 82 | Check WAL Log Archiving | hbase wal | Inspects write-ahead log files in HDFS. |
| 83 | Roll HLog Files | wal_roll | Forces RegionServer to roll WAL log file. |
| 84 | Check Region Split Status | splitormerge_switch 'SPLIT', true | Enables automatic region splitting. |
| 85 | Disable Region Split | splitormerge_switch 'SPLIT', false | Disables automatic region splitting. |
| 86 | Disable Region Merge | splitormerge_switch 'MERGE', false | Disables automatic region merging. |
| 87 | Trace Row Key Location | locate_region 'enterprise_users', 'row100' | Identifies RegionServer hosting rowkey. |
| 88 | Get Region Server Metrics HTTP | curl http://localhost:16030/jmx | Pulls JMX performance telemetry from RegionServer. |
| 89 | Get Master Metrics HTTP | curl http://localhost:16010/jmx | Pulls JMX performance telemetry from Master node. |
| 90 | Check HBase Shell Version | version | Outputs client shell build version string. |
| 91 | Quiet Exit HBase Shell | quit | Closes command-line interactive shell. |
| 92 | Check Region Server Log | hbase log | Pulls active RegionServer log output. |
| 93 | Check Master Status HTTP | curl http://localhost:16010/master-status | Fetches HTML master dashboard status. |
| 94 | Check Dump Command | hbase pe | Runs PerformanceEvaluation load testing tool. |
| 95 | Check L2 Block Cache | alter 'enterprise_users', {NAME => 'personal', IN_MEMORY => 'true', BLOCKCACHE => 'true'} | Enables block cache for family. |
| 96 | Check Column Family Data Block | alter 'enterprise_users', {NAME => 'personal', DATA_BLOCK_ENCODING => 'PREFIX'} | Enables Prefix encoding. |
| 97 | Check Table Max File Size | alter 'enterprise_users', {MAX_FILESIZE => '10737418240'} | Sets max HFile size before region split. |
| 98 | Check Table Memstore Flush Size | alter 'enterprise_users', {MEMSTORE_FLUSHSIZE => '134217728'} | Sets 128MB memstore flush threshold. |
| 99 | Check Table Read Only | alter 'enterprise_users', READONLY => true | Enforces read-only status on table. |
| 100 | Check Table Read Write | alter 'enterprise_users', READONLY => false | Restores write status on table. |
| 101 | Open HBase Shell Option 1 | hbase shell | Launches interactive HBase shell. |
| 102 | Start Service Option 2 | start-hbase.sh | Boots HBase master and regionservers. |
| 103 | Stop Service Option 3 | stop-hbase.sh | Stops HBase services. |
| 104 | Create Table Option 4 | create 'enterprise_users', 'personal', 'professional' | Provisions table with column families. |
| 105 | Disable Table Option 5 | disable 'enterprise_users' | Disables table before alteration. |
| 106 | Drop Table Option 6 | drop 'enterprise_users' | Deletes HBase table. |
| 107 | Enable Table Option 7 | enable 'enterprise_users' | Enables disabled table. |
| 108 | List Tables Option 8 | list | Outputs all active table names. |
| 109 | Describe Table Option 9 | describe 'enterprise_users' | Inspects column family schemas. |
| 110 | Put Record Option 10 | put 'enterprise_users', 'row1', 'personal:name', 'Alice' | Writes cell value into table. |
| 111 | Get Record Option 11 | get 'enterprise_users', 'row1' | Retrieves cell values for row key. |
| 112 | Scan Table Option 12 | scan 'enterprise_users', {LIMIT => 10} | Scans rows from table. |
| 113 | Delete Cell Value Option 13 | delete 'enterprise_users', 'row1', 'personal:name' | Removes cell value. |
| 114 | Delete Entire Row Option 14 | deleteall 'enterprise_users', 'row1' | Removes entire row key. |
| 115 | Count Rows Option 15 | count 'enterprise_users' | Calculates total row count. |
| 116 | Alter Table Column Family Option 16 | alter 'enterprise_users', {NAME => 'professional', VERSIONS => 5} | Modifies column family settings. |
| 117 | Add Column Family Option 17 | alter 'enterprise_users', 'audit' | Provisions new column family. |
| 118 | Remove Column Family Option 18 | alter 'enterprise_users', {NAME => 'audit', METHOD => 'delete'} | Deletes column family. |
| 119 | Check Cluster Status Option 19 | status 'detailed' | Inspects regionserver node health. |
| 120 | Check Region Server Version Option 20 | version | Outputs running HBase version. |
| 121 | Flush Table Option 21 | flush 'enterprise_users' | Forces memstore flush to HFiles. |
| 122 | Compact Table Option 22 | major_compact 'enterprise_users' | Forces major compaction of HFiles. |
| 123 | Snapshot Table Option 23 | snapshot 'enterprise_users', 'users_snap_01' | Takes metadata storage snapshot. |
| 124 | Restore Snapshot Option 24 | restore_snapshot 'users_snap_01' | Restores table from snapshot. |
| 125 | Clone Snapshot Option 25 | clone_snapshot 'users_snap_01', 'enterprise_users_clone' | Clones table from snapshot. |
| 126 | Delete Snapshot Option 26 | delete_snapshot 'users_snap_01' | Removes storage snapshot. |
| 127 | Check Balancer State Option 27 | balancer | Executes region balancer algorithm. |
| 128 | Assign Region Option 28 | assign 'REGION_HASH_ID' | Forces region assignment to server. |
| 129 | Unassign Region Option 29 | unassign 'REGION_HASH_ID' | Unassigns region from server. |
| 130 | Exit Shell Option 30 | exit | Closes interactive HBase shell. |
| 131 | Check Table Existence Option 31 | exists 'enterprise_users' | Checks if specified table exists in catalog. |
| 132 | Check Table Enabled Status Option 32 | is_enabled 'enterprise_users' | Verifies whether table is active. |
| 133 | Check Table Disabled Status Option 33 | is_disabled 'enterprise_users' | Verifies whether table is disabled. |
| 134 | Scan Table Column Subset Option 34 | scan 'enterprise_users', {COLUMNS => ['personal:name']} | Scans only specific column family or qualifier. |
| 135 | Scan Table Row Prefix Filter Option 35 | scan 'enterprise_users', {ROWPREFIXFILTER => 'usr_'} | Scans rows matching rowkey prefix. |
| 136 | Scan Table Timerange Option 36 | scan 'enterprise_users', {TIMERANGE => [1700000000000, 1710000000000]} | Scans cell versions within millisecond time window. |
| 137 | Scan Table Reversed Option 37 | scan 'enterprise_users', {REVERSED => true, LIMIT => 10} | Scans table rows in reverse key order. |
| 138 | Get Record Specific Column Option 38 | get 'enterprise_users', 'row1', {COLUMN => 'personal:name'} | Fetches value for single column qualifier. |
| 139 | Get Record Max Versions Option 39 | get 'enterprise_users', 'row1', {VERSIONS => 5} | Fetches up to 5 historical versions of cell. |
| 140 | Get Record Timestamp Option 40 | get 'enterprise_users', 'row1', {TIMESTAMP => 1715000000000} | Fetches cell value at exact millisecond timestamp. |
| 141 | Put Record with Timestamp Option 41 | put 'enterprise_users', 'row1', 'personal:name', 'Alice', 1715000000000 | Writes cell value with explicit timestamp. |
| 142 | Truncate Table Option 42 | truncate 'enterprise_users' | Disables, drops, and recreates table to clear rows. |
| 143 | Alter Table Compression Option 43 | alter 'enterprise_users', {NAME => 'personal', COMPRESSION => 'SNAPPY'} | Applies Snappy compression to column family. |
| 144 | Alter Table Blocksize Option 44 | alter 'enterprise_users', {NAME => 'personal', BLOCKSIZE => '131072'} | Configures 128KB HFile block size for family. |
| 145 | Alter Table In Memory Option 45 | alter 'enterprise_users', {NAME => 'personal', IN_MEMORY => 'true'} | Hints regionservers to cache column family block in RAM. |
| 146 | Alter Table Bloom Filter Option 46 | alter 'enterprise_users', {NAME => 'personal', BLOOMFILTER => 'ROW'} | Activates row-key Bloom filter for fast lookup. |
| 147 | Alter Table Data Block Encoding Option 47 | alter 'enterprise_users', {NAME => 'personal', DATA_BLOCK_ENCODING => 'FAST_DIFF'} | Enables FastDiff block encoding. |
| 148 | Minor Compact Table Option 48 | compact 'enterprise_users' | Triggers minor compaction of memstores and HFiles. |
| 149 | Compact Specific Region Option 49 | compact 'REGION_HASH_ID' | Triggers compaction on a single region. |
| 150 | Major Compact Specific Region Option 50 | major_compact 'REGION_HASH_ID' | Triggers major compaction on a single region. |
| 151 | Split Region Manually Option 51 | split 'REGION_HASH_ID', 'row500' | Splits region at specified rowkey boundary. |
| 152 | Merge Regions Manually Option 52 | merge_region 'REGION_HASH_ID_1', 'REGION_HASH_ID_2' | Merges two adjacent regions. |
| 153 | List Snapshots Option 53 | list_snapshots | Outputs all saved storage snapshots. |
| 154 | List Table Snapshots Option 54 | list_snapshots 'enterprise_users.*' | Outputs snapshots matching regex pattern. |
| 155 | Check Catalog Namespace List Option 55 | list_namespace | Lists all logical table namespaces. |
| 156 | Create Namespace Option 56 | create_namespace 'staging_ns' | Provisions logical table namespace. |
| 157 | Drop Namespace Option 57 | drop_namespace 'staging_ns' | Deletes empty table namespace. |
| 158 | Create Table in Namespace Option 58 | create 'staging_ns:logs', 'f1' | Provisions table inside namespace. |
| 159 | List Tables in Namespace Option 59 | list_namespace_tables 'staging_ns' | Lists tables belonging to namespace. |
| 160 | Describe Namespace Option 60 | describe_namespace 'staging_ns' | Inspects properties of namespace. |
| 161 | Grant User Permissions Option 61 | grant 'app_user', 'RW', 'enterprise_users' | Grants Read/Write rights on table. |
| 162 | Revoke User Permissions Option 62 | revoke 'app_user', 'enterprise_users' | Revokes access rights on table. |
| 163 | List User Permissions Option 63 | user_permission 'app_user' | Inspects permissions assigned to user. |
| 164 | Check Balancer Status Option 64 | balancer_enabled | Inspects whether region balancer is running. |
| 165 | Enable Balancer Option 65 | balance_switch true | Activates region balancer daemon. |
| 166 | Disable Balancer Option 66 | balance_switch false | Deactivates region balancer daemon. |
| 167 | Check Catalog System Tables Option 67 | list 'hbase:*' | Lists system catalog tables (hbase:meta). |
| 168 | Scan Meta Table Option 68 | scan 'hbase:meta' | Queries system catalog table for region locations. |
| 169 | Check Quotas List Option 69 | list_quotas | Lists active namespace and table quotas. |
| 170 | Set Table Quota Space Option 70 | set_quota TYPE => SPACE, LIMIT => '100G', TABLE => 'enterprise_users' | Enforces 100GB storage quota on table. |
| 171 | Set Namespace Quota Space Option 71 | set_quota TYPE => SPACE, LIMIT => '1T', NAMESPACE => 'staging_ns' | Enforces 1TB storage quota on namespace. |
| 172 | Remove Table Quota Option 72 | set_quota TYPE => SPACE, LIMIT => NONE, TABLE => 'enterprise_users' | Removes storage quota from table. |
| 173 | Check hbck Status (CLI) Option 73 | hbase hbck | Scans cluster for region inconsistency and overlaps. |
| 174 | Fix hbck Inconsistencies Option 74 | hbase hbck -fix | Repairs broken region assignments in hbase:meta. |
| 175 | Check Master Health Option 75 | hbase master | Boots/checks Master daemon health. |
| 176 | Check RegionServer Health Option 76 | hbase regionserver | Boots/checks RegionServer daemon health. |
| 177 | Check ZooKeeper Nodes Option 77 | hbase zkcli ls /hbase | Queries ZooKeeper z-node tree for HBase status. |
| 178 | Set Normalization Mode Option 78 | normalizer_switch true | Activates region normalizer for size uniformity. |
| 179 | Check Normalization Status Option 79 | normalizer_enabled | Inspects whether region normalizer is active. |
| 180 | Run Normalizer Option 80 | normalize | Executes on-demand region normalization. |
| 181 | Check Active Compaction Queues Option 81 | compaction_switch true | Activates background compaction executor. |
| 182 | Check WAL Log Archiving Option 82 | hbase wal | Inspects write-ahead log files in HDFS. |
| 183 | Roll HLog Files Option 83 | wal_roll | Forces RegionServer to roll WAL log file. |
| 184 | Check Region Split Status Option 84 | splitormerge_switch 'SPLIT', true | Enables automatic region splitting. |
| 185 | Disable Region Split Option 85 | splitormerge_switch 'SPLIT', false | Disables automatic region splitting. |
| 186 | Disable Region Merge Option 86 | splitormerge_switch 'MERGE', false | Disables automatic region merging. |
| 187 | Trace Row Key Location Option 87 | locate_region 'enterprise_users', 'row100' | Identifies RegionServer hosting rowkey. |
| 188 | Get Region Server Metrics HTTP Option 88 | curl http://localhost:16030/jmx | Pulls JMX performance telemetry from RegionServer. |
| 189 | Get Master Metrics HTTP Option 89 | curl http://localhost:16010/jmx | Pulls JMX performance telemetry from Master node. |
| 190 | Check HBase Shell Version Option 90 | version | Outputs client shell build version string. |
| 191 | Quiet Exit HBase Shell Option 91 | quit | Closes command-line interactive shell. |
| 192 | Check Region Server Log Option 92 | hbase log | Pulls active RegionServer log output. |
| 193 | Check Master Status HTTP Option 93 | curl http://localhost:16010/master-status | Fetches HTML master dashboard status. |
| 194 | Check Dump Command Option 94 | hbase pe | Runs PerformanceEvaluation load testing tool. |
| 195 | Check L2 Block Cache Option 95 | alter 'enterprise_users', {NAME => 'personal', IN_MEMORY => 'true', BLOCKCACHE => 'true'} | Enables block cache for family. |
| 196 | Check Column Family Data Block Option 96 | alter 'enterprise_users', {NAME => 'personal', DATA_BLOCK_ENCODING => 'PREFIX'} | Enables Prefix encoding. |
| 197 | Check Table Max File Size Option 97 | alter 'enterprise_users', {MAX_FILESIZE => '10737418240'} | Sets max HFile size before region split. |
| 198 | Check Table Memstore Flush Size Option 98 | alter 'enterprise_users', {MEMSTORE_FLUSHSIZE => '134217728'} | Sets 128MB memstore flush threshold. |
| 199 | Check Table Read Only Option 99 | alter 'enterprise_users', READONLY => true | Enforces read-only status on table. |
| 200 | Check Table Read Write Option 100 | alter 'enterprise_users', READONLY => false | Restores write status on table. |
CouchDB NOSQL
Technical Architecture & Overview
Apache CouchDB is a document-oriented NoSQL database featuring a RESTful HTTP/JSON API, ACID compliance at the document level, B-tree indexing, and CouchDB's multi-master master-master replication protocol with continuous change streams.
Primary Use Cases: Offline-first mobile and desktop applications, distributed edge database nodes, disconnected sync systems, and JSON document stores.
Core Components: Erlang OTP Engine, B-Tree Storage, REST HTTP API, _changes Feed, JavaScript MapReduce Views, and Couch Replication Protocol.
Exhaustive 200-command administrative, diagnostic, and operational matrix for CouchDB.
| # | Operation / Action | cURL API Syntax | Description |
|---|---|---|---|
| 1 | Check Server Status | curl http://localhost:5984/ | Verifies CouchDB node health. |
| 2 | List Databases | curl http://admin:pass@localhost:5984/_all_dbs | Outputs all database names. |
| 3 | Create Database | curl -X PUT http://admin:pass@localhost:5984/enterprise_db | Provisions new document database. |
| 4 | Delete Database | curl -X DELETE http://admin:pass@localhost:5984/enterprise_db | Deletes database instance. |
| 5 | Get Database Info | curl http://admin:pass@localhost:5984/enterprise_db | Inspects database document counts. |
| 6 | Create Document (Auto ID) | curl -X POST -H 'Content-Type: application/json' -d '{"name":"Alice"}' http://admin:pass@localhost:5984/enterprise_db | Inserts document with generated ID. |
| 7 | Create Document (Custom ID) | curl -X PUT -H 'Content-Type: application/json' -d '{"name":"Alice"}' http://admin:pass@localhost:5984/enterprise_db/user1 | Inserts document with custom ID. |
| 8 | Get Document | curl http://admin:pass@localhost:5984/enterprise_db/user1 | Retrieves JSON document by ID. |
| 9 | Update Document | curl -X PUT -H 'Content-Type: application/json' -d '{"name":"Alicia","_rev":"1-abc"}' http://admin:pass@localhost:5984/enterprise_db/user1 | Modifies document revision. |
| 10 | Delete Document | curl -X DELETE http://admin:pass@localhost:5984/enterprise_db/user1?rev=1-abc | Removes document record. |
| 11 | List All Documents | curl http://admin:pass@localhost:5984/enterprise_db/_all_docs?include_docs=true | Outputs all database documents. |
| 12 | Create Design Document (View) | curl -X PUT -H 'Content-Type: application/json' -d '{"views":{"by_name":{"map":"function(doc){emit(doc.name,1)}"}}}' http://admin:pass@localhost:5984/enterprise_db/_design/users | Provisions map-reduce index view. |
| 13 | Query Design View | curl http://admin:pass@localhost:5984/enterprise_db/_design/users/_view/by_name | Queries map-reduce index. |
| 14 | Create Mango Index | curl -X POST -H 'Content-Type: application/json' -d '{"index":{"fields":["name"]}}' http://admin:pass@localhost:5984/enterprise_db/_index | Provisions Mango JSON query index. |
| 15 | Query Mango Index | curl -X POST -H 'Content-Type: application/json' -d '{"selector":{"name":"Alice"}}' http://admin:pass@localhost:5984/enterprise_db/_find | Executes Mango JSON query. |
| 16 | Compact Database | curl -X POST -H 'Content-Type: application/json' http://admin:pass@localhost:5984/enterprise_db/_compact | Defragments database storage files. |
| 17 | View Active Tasks | curl http://admin:pass@localhost:5984/_active_tasks | Inspects background compaction tasks. |
| 18 | Get Server Membership | curl http://admin:pass@localhost:5984/_membership | Inspects cluster node membership. |
| 19 | Setup Cluster Node | curl -X POST -H 'Content-Type: application/json' -d '{"action":"enable_cluster","nodes":1}' http://admin:pass@localhost:5984/_cluster_setup | Configures clustering nodes. |
| 20 | Create Replication Job | curl -X POST -H 'Content-Type: application/json' -d '{"source":"enterprise_db","target":"http://remote/enterprise_db","continuous":true}' http://admin:pass@localhost:5984/_replicate | Provisions continuous data replication. |
| 21 | List Replication Jobs | curl http://admin:pass@localhost:5984/_scheduler/jobs | Inspects active replication tasks. |
| 22 | Get Node Config | curl http://admin:pass@localhost:5984/_node/nonode@nohost/_config | Inspects server configuration parameters. |
| 23 | Update Node Config | curl -X PUT -H 'Content-Type: application/json' -d '"10000"' http://admin:pass@localhost:5984/_node/nonode@nohost/_config/httpd/max_http_request_size | Modifies server configuration. |
| 24 | Purge Documents | curl -X POST -H 'Content-Type: application/json' -d '{"user1":["1-abc"]}' http://admin:pass@localhost:5984/enterprise_db/_purge | Permanently purges document revisions. |
| 25 | Get Database Security Settings | curl http://admin:pass@localhost:5984/enterprise_db/_security | Inspects database security roles. |
| 26 | Update Database Security Settings | curl -X PUT -H 'Content-Type: application/json' -d '{"admins":{"names":["admin"],"roles":[]},"readers":{"names":[],"roles":[]}}' http://admin:pass@localhost:5984/enterprise_db/_security | Configures database access rights. |
| 27 | Get Server UUIDs | curl http://admin:pass@localhost:5984/_uuids?count=10 | Generates unique document IDs. |
| 28 | View Cluster Stats | curl http://admin:pass@localhost:5984/_stats | Pulls server performance metrics. |
| 29 | Get Log File Segment | curl http://admin:pass@localhost:5984/_log?bytes=1000 | Downloads server error logs. |
| 30 | Restart Node | curl -X POST http://admin:pass@localhost:5984/_restart | Restarts CouchDB server node. |
| 31 | Get Document Head Meta | curl -I http://admin:pass@localhost:5984/enterprise_db/user1 | Fetches document headers and _rev without body. |
| 32 | Get Document Revisions List | curl http://admin:pass@localhost:5984/enterprise_db/user1?revs_info=true | Lists historical revision IDs for document. |
| 33 | Get Specific Document Revision | curl http://admin:pass@localhost:5984/enterprise_db/user1?rev=1-abc | Fetches specific historical revision of document. |
| 34 | Get Document Revisions Conflict Tree | curl http://admin:pass@localhost:5984/enterprise_db/user1?open_revs=all | Retrieves branch revisions tree for conflict resolution. |
| 35 | Bulk Insert Documents | curl -X POST -H 'Content-Type: application/json' -d '{"docs":[{"name":"Bob"},{"name":"Charlie"}]}' http://admin:pass@localhost:5984/enterprise_db/_bulk_docs | Inserts multiple documents in single HTTP request. |
| 36 | Bulk Delete Documents | curl -X POST -H 'Content-Type: application/json' -d '{"docs":[{"_id":"user1","_rev":"1-abc","_deleted":true}]}' http://admin:pass@localhost:5984/enterprise_db/_bulk_docs | Batch deletes documents in single HTTP request. |
| 37 | Get Changes Feed | curl http://admin:pass@localhost:5984/enterprise_db/_changes?since=now&feed=continuous | Streams real-time document mutation feed. |
| 38 | Get Longpoll Changes Feed | curl http://admin:pass@localhost:5984/enterprise_db/_changes?feed=longpoll | Long-polls database for new document changes. |
| 39 | Get Filtered Changes Feed | curl http://admin:pass@localhost:5984/enterprise_db/_changes?filter=users/by_type&type=admin | Filters changes feed using design document filter. |
| 40 | Attach File to Document | curl -X PUT -H 'image/png' --data-binary @logo.png http://admin:pass@localhost:5984/enterprise_db/user1/logo.png?rev=1-abc | Uploads binary attachment to document. |
| 41 | Get File Attachment | curl http://admin:pass@localhost:5984/enterprise_db/user1/logo.png | Downloads binary attachment from document. |
| 42 | Delete File Attachment | curl -X DELETE http://admin:pass@localhost:5984/enterprise_db/user1/logo.png?rev=2-bcd | Removes binary attachment from document. |
| 43 | Get Design Document | curl http://admin:pass@localhost:5984/enterprise_db/_design/users | Retrieves design document definitions. |
| 44 | Delete Design Document | curl -X DELETE http://admin:pass@localhost:5984/enterprise_db/_design/users?rev=1-xyz | Deletes design document view. |
| 45 | Compact Views | curl -X POST -H 'Content-Type: application/json' http://admin:pass@localhost:5984/enterprise_db/_compact/users | Defragments specific view index files. |
| 46 | Cleanup View Indexes | curl -X POST -H 'Content-Type: application/json' http://admin:pass@localhost:5984/enterprise_db/_view_cleanup | Purges index files for deleted design views. |
| 47 | List Mango Indexes | curl http://admin:pass@localhost:5984/enterprise_db/_index | Lists all active Mango JSON indexes. |
| 48 | Delete Mango Index | curl -X DELETE http://admin:pass@localhost:5984/enterprise_db/_index/design_doc/json/index_name | Deletes Mango JSON index. |
| 49 | Explain Mango Query | curl -X POST -H 'Content-Type: application/json' -d '{"selector":{"name":"Alice"},"execution_stats":true}' http://admin:pass@localhost:5984/enterprise_db/_explain | Outputs execution stats and chosen index for query. |
| 50 | Create Admin User | curl -X PUT http://admin:pass@localhost:5984/_node/nonode@nohost/_config/admins/jlawrence -d '"SecurePass123!"' | Provisions server admin login. |
| 51 | Delete Admin User | curl -X DELETE http://admin:pass@localhost:5984/_node/nonode@nohost/_config/admins/jlawrence | Deletes server admin login. |
| 52 | Create System User Document | curl -X PUT -H 'Content-Type: application/json' -d '{"name":"appuser","password":"Pass123!","roles":[],"type":"user"}' http://admin:pass@localhost:5984/_users/org.couchdb.user:appuser | Provisions database user in _users collection. |
| 53 | Get System User Document | curl http://admin:pass@localhost:5984/_users/org.couchdb.user:appuser | Fetches user security record. |
| 54 | Delete System User Document | curl -X DELETE http://admin:pass@localhost:5984/_users/org.couchdb.user:appuser?rev=1-abc | Deletes user record. |
| 55 | Get Scheduler Docs | curl http://admin:pass@localhost:5984/_scheduler/docs | Lists active replication document tasks. |
| 56 | Get Scheduler Doc Details | curl http://admin:pass@localhost:5984/_scheduler/docs/_replicator/job_id | Inspects specific replication task state. |
| 57 | Create Replicator Doc | curl -X POST -H 'Content-Type: application/json' -d '{"source":"enterprise_db","target":"http://remote:5984/db_replica","continuous":true}' http://admin:pass@localhost:5984/_replicator | Provisions persistent replication task. |
| 58 | Delete Replicator Doc | curl -X DELETE http://admin:pass@localhost:5984/_replicator/doc_id?rev=1-abc | Cancels persistent replication task. |
| 59 | Get Node System Info | curl http://admin:pass@localhost:5984/_node/nonode@nohost | Inspects Erlang process and memory info. |
| 60 | Get Node System Stats | curl http://admin:pass@localhost:5984/_node/nonode@nohost/_stats | Inspects Erlang VM garbage collection stats. |
| 61 | Check Database Commit Limit | curl http://admin:pass@localhost:5984/enterprise_db/_committed | Verifies disk sync state. |
| 62 | Ensure Full Commit | curl -X POST -H 'Content-Type: application/json' http://admin:pass@localhost:5984/enterprise_db/_ensure_full_commit | Forces immediate disk sync for database. |
| 63 | Get Database Shard Map | curl http://admin:pass@localhost:5984/enterprise_db/_shards | Inspects partition shard map across nodes. |
| 64 | Get Document Shard Info | curl http://admin:pass@localhost:5984/enterprise_db/_shards/user1 | Identifies cluster nodes hosting specific document. |
| 65 | Get Cluster Nodes List | curl http://admin:pass@localhost:5984/_node/nonode@nohost/_nodes | Lists connected CouchDB cluster nodes. |
| 66 | Add Node to Cluster | curl -X PUT http://admin:pass@localhost:5984/_node/nonode@nohost/_nodes/node2@10.0.0.2 -d '{}' | Adds node to CouchDB cluster. |
| 67 | Delete Node from Cluster | curl -X DELETE http://admin:pass@localhost:5984/_node/nonode@nohost/_nodes/node2@10.0.0.2?rev=1-abc | Removes node from CouchDB cluster. |
| 68 | Set Max Document Size | curl -X PUT http://admin:pass@localhost:5984/_node/nonode@nohost/_config/couchdb/max_document_size -d '"67108864"' | Caps max document payload to 64MB. |
| 69 | Set HTTP Port | curl -X PUT http://admin:pass@localhost:5984/_node/nonode@nohost/_config/chttpd/port -d '"5984"' | Updates HTTP listening port. |
| 70 | Set CORS Enable | curl -X PUT http://admin:pass@localhost:5984/_node/nonode@nohost/_config/httpd/enable_cors -d '"true"' | Enables Cross-Origin Resource Sharing. |
| 71 | Set CORS Origins | curl -X PUT http://admin:pass@localhost:5984/_node/nonode@nohost/_config/cors/origins -d '"*"' | Allows all origins in CORS header. |
| 72 | Set Compaction Threshold | curl -X PUT http://admin:pass@localhost:5984/_node/nonode@nohost/_config/database_compaction/db_fragmentation -d '"70"' | Triggers compaction at 70% fragmentation. |
| 73 | Get System DB List | curl http://admin:pass@localhost:5984/_sys_dbs | Lists internal system databases (_users, _replicator, _global_changes). |
| 74 | Check Prometheus Metrics | curl http://admin:pass@localhost:5984/_node/nonode@nohost/_prometheus | Pulls Prometheus metrics endpoint. |
| 75 | Get Up Metric | curl http://admin:pass@localhost:5984/_up | Simple ping endpoint returning status ok. |
| 76 | Set WWW Authentication | curl -X PUT http://admin:pass@localhost:5984/_node/nonode@nohost/_config/chttpd/require_valid_user -d '"true"' | Enforces mandatory authentication. |
| 77 | Check Database Size Bytes | curl -s http://admin:pass@localhost:5984/enterprise_db | grep sizes | Pulls active vs file disk sizes. |
| 78 | Flush Database Cache | curl -X POST http://admin:pass@localhost:5984/enterprise_db/_flush | Flushes buffer cache to disk. |
| 79 | Check Erlang VM Version | curl -s http://admin:pass@localhost:5984/ | grep erlang | Outputs Erlang OTP release version. |
| 80 | Check CouchDB Version String | curl http://localhost:5984/ | grep version | Outputs running CouchDB release version. |
| 81 | Check DB Doc Del Count | curl http://admin:pass@localhost:5984/enterprise_db | grep doc_del_count | Inspects deleted document tombstone count. |
| 82 | Check DB Disk Size | curl http://admin:pass@localhost:5984/enterprise_db | grep disk_size | Inspects total disk file size. |
| 83 | Check DB Data Size | curl http://admin:pass@localhost:5984/enterprise_db | grep data_size | Inspects active uncompressed payload size. |
| 84 | Check Node Memory System | curl http://admin:pass@localhost:5984/_node/nonode@nohost/_system | Inspects system memory and swap. |
| 85 | Check Node Erlang Memory | curl http://admin:pass@localhost:5984/_node/nonode@nohost/_system | grep memory | Inspects Erlang process memory. |
| 86 | Check Active Server UUID | curl http://admin:pass@localhost:5984/_uuids | Generates single UUID. |
| 87 | Set Log Level Debug | curl -X PUT http://admin:pass@localhost:5984/_node/nonode@nohost/_config/log/level -d '"debug"' | Sets system logging level to debug. |
| 88 | Set Log Level Info | curl -X PUT http://admin:pass@localhost:5984/_node/nonode@nohost/_config/log/level -d '"info"' | Sets system logging level to info. |
| 89 | Set Log Level Error | curl -X PUT http://admin:pass@localhost:5984/_node/nonode@nohost/_config/log/level -d '"error"' | Sets system logging level to error. |
| 90 | Check Security Roles | curl http://admin:pass@localhost:5984/_security | Inspects server-level security policy. |
| 91 | Check Replicator DB | curl http://admin:pass@localhost:5984/_replicator | Inspects _replicator system database. |
| 92 | Check Global Changes DB | curl http://admin:pass@localhost:5984/_global_changes | Inspects _global_changes system database. |
| 93 | Check Users DB | curl http://admin:pass@localhost:5984/_users | Inspects _users system database. |
| 94 | Get Replicator Doc State | curl http://admin:pass@localhost:5984/_replicator/doc_id | Inspects status of replication document. |
| 95 | Check All Docs Limit | curl http://admin:pass@localhost:5984/enterprise_db/_all_docs?limit=10 | Paginates first 10 documents. |
| 96 | Check All Docs Skip | curl http://admin:pass@localhost:5984/enterprise_db/_all_docs?skip=10&limit=10 | Skips 10 documents and fetches next 10. |
| 97 | Check All Docs Startkey | curl http://admin:pass@localhost:5984/enterprise_db/_all_docs?startkey="user1"&limit=5 | Queries documents starting from key. |
| 98 | Check All Docs Endkey | curl http://admin:pass@localhost:5984/enterprise_db/_all_docs?endkey="user9"&limit=5 | Queries documents ending at key. |
| 99 | Check All Docs Keys Array | curl -X POST -H 'Content-Type: application/json' -d '{"keys":["user1","user2"]}' http://admin:pass@localhost:5984/enterprise_db/_all_docs | Fetches specific documents in bulk. |
| 100 | Check Version REST API | curl http://localhost:5984/ | grep version | Verifies REST API version. |
| 101 | Check Server Status Option 1 | curl http://localhost:5984/ | Verifies CouchDB node health. |
| 102 | List Databases Option 2 | curl http://admin:pass@localhost:5984/_all_dbs | Outputs all database names. |
| 103 | Create Database Option 3 | curl -X PUT http://admin:pass@localhost:5984/enterprise_db | Provisions new document database. |
| 104 | Delete Database Option 4 | curl -X DELETE http://admin:pass@localhost:5984/enterprise_db | Deletes database instance. |
| 105 | Get Database Info Option 5 | curl http://admin:pass@localhost:5984/enterprise_db | Inspects database document counts. |
| 106 | Create Document (Auto ID) Option 6 | curl -X POST -H 'Content-Type: application/json' -d '{"name":"Alice"}' http://admin:pass@localhost:5984/enterprise_db | Inserts document with generated ID. |
| 107 | Create Document (Custom ID) Option 7 | curl -X PUT -H 'Content-Type: application/json' -d '{"name":"Alice"}' http://admin:pass@localhost:5984/enterprise_db/user1 | Inserts document with custom ID. |
| 108 | Get Document Option 8 | curl http://admin:pass@localhost:5984/enterprise_db/user1 | Retrieves JSON document by ID. |
| 109 | Update Document Option 9 | curl -X PUT -H 'Content-Type: application/json' -d '{"name":"Alicia","_rev":"1-abc"}' http://admin:pass@localhost:5984/enterprise_db/user1 | Modifies document revision. |
| 110 | Delete Document Option 10 | curl -X DELETE http://admin:pass@localhost:5984/enterprise_db/user1?rev=1-abc | Removes document record. |
| 111 | List All Documents Option 11 | curl http://admin:pass@localhost:5984/enterprise_db/_all_docs?include_docs=true | Outputs all database documents. |
| 112 | Create Design Document (View) Option 12 | curl -X PUT -H 'Content-Type: application/json' -d '{"views":{"by_name":{"map":"function(doc){emit(doc.name,1)}"}}}' http://admin:pass@localhost:5984/enterprise_db/_design/users | Provisions map-reduce index view. |
| 113 | Query Design View Option 13 | curl http://admin:pass@localhost:5984/enterprise_db/_design/users/_view/by_name | Queries map-reduce index. |
| 114 | Create Mango Index Option 14 | curl -X POST -H 'Content-Type: application/json' -d '{"index":{"fields":["name"]}}' http://admin:pass@localhost:5984/enterprise_db/_index | Provisions Mango JSON query index. |
| 115 | Query Mango Index Option 15 | curl -X POST -H 'Content-Type: application/json' -d '{"selector":{"name":"Alice"}}' http://admin:pass@localhost:5984/enterprise_db/_find | Executes Mango JSON query. |
| 116 | Compact Database Option 16 | curl -X POST -H 'Content-Type: application/json' http://admin:pass@localhost:5984/enterprise_db/_compact | Defragments database storage files. |
| 117 | View Active Tasks Option 17 | curl http://admin:pass@localhost:5984/_active_tasks | Inspects background compaction tasks. |
| 118 | Get Server Membership Option 18 | curl http://admin:pass@localhost:5984/_membership | Inspects cluster node membership. |
| 119 | Setup Cluster Node Option 19 | curl -X POST -H 'Content-Type: application/json' -d '{"action":"enable_cluster","nodes":1}' http://admin:pass@localhost:5984/_cluster_setup | Configures clustering nodes. |
| 120 | Create Replication Job Option 20 | curl -X POST -H 'Content-Type: application/json' -d '{"source":"enterprise_db","target":"http://remote/enterprise_db","continuous":true}' http://admin:pass@localhost:5984/_replicate | Provisions continuous data replication. |
| 121 | List Replication Jobs Option 21 | curl http://admin:pass@localhost:5984/_scheduler/jobs | Inspects active replication tasks. |
| 122 | Get Node Config Option 22 | curl http://admin:pass@localhost:5984/_node/nonode@nohost/_config | Inspects server configuration parameters. |
| 123 | Update Node Config Option 23 | curl -X PUT -H 'Content-Type: application/json' -d '"10000"' http://admin:pass@localhost:5984/_node/nonode@nohost/_config/httpd/max_http_request_size | Modifies server configuration. |
| 124 | Purge Documents Option 24 | curl -X POST -H 'Content-Type: application/json' -d '{"user1":["1-abc"]}' http://admin:pass@localhost:5984/enterprise_db/_purge | Permanently purges document revisions. |
| 125 | Get Database Security Settings Option 25 | curl http://admin:pass@localhost:5984/enterprise_db/_security | Inspects database security roles. |
| 126 | Update Database Security Settings Option 26 | curl -X PUT -H 'Content-Type: application/json' -d '{"admins":{"names":["admin"],"roles":[]},"readers":{"names":[],"roles":[]}}' http://admin:pass@localhost:5984/enterprise_db/_security | Configures database access rights. |
| 127 | Get Server UUIDs Option 27 | curl http://admin:pass@localhost:5984/_uuids?count=10 | Generates unique document IDs. |
| 128 | View Cluster Stats Option 28 | curl http://admin:pass@localhost:5984/_stats | Pulls server performance metrics. |
| 129 | Get Log File Segment Option 29 | curl http://admin:pass@localhost:5984/_log?bytes=1000 | Downloads server error logs. |
| 130 | Restart Node Option 30 | curl -X POST http://admin:pass@localhost:5984/_restart | Restarts CouchDB server node. |
| 131 | Get Document Head Meta Option 31 | curl -I http://admin:pass@localhost:5984/enterprise_db/user1 | Fetches document headers and _rev without body. |
| 132 | Get Document Revisions List Option 32 | curl http://admin:pass@localhost:5984/enterprise_db/user1?revs_info=true | Lists historical revision IDs for document. |
| 133 | Get Specific Document Revision Option 33 | curl http://admin:pass@localhost:5984/enterprise_db/user1?rev=1-abc | Fetches specific historical revision of document. |
| 134 | Get Document Revisions Conflict Tree Option 34 | curl http://admin:pass@localhost:5984/enterprise_db/user1?open_revs=all | Retrieves branch revisions tree for conflict resolution. |
| 135 | Bulk Insert Documents Option 35 | curl -X POST -H 'Content-Type: application/json' -d '{"docs":[{"name":"Bob"},{"name":"Charlie"}]}' http://admin:pass@localhost:5984/enterprise_db/_bulk_docs | Inserts multiple documents in single HTTP request. |
| 136 | Bulk Delete Documents Option 36 | curl -X POST -H 'Content-Type: application/json' -d '{"docs":[{"_id":"user1","_rev":"1-abc","_deleted":true}]}' http://admin:pass@localhost:5984/enterprise_db/_bulk_docs | Batch deletes documents in single HTTP request. |
| 137 | Get Changes Feed Option 37 | curl http://admin:pass@localhost:5984/enterprise_db/_changes?since=now&feed=continuous | Streams real-time document mutation feed. |
| 138 | Get Longpoll Changes Feed Option 38 | curl http://admin:pass@localhost:5984/enterprise_db/_changes?feed=longpoll | Long-polls database for new document changes. |
| 139 | Get Filtered Changes Feed Option 39 | curl http://admin:pass@localhost:5984/enterprise_db/_changes?filter=users/by_type&type=admin | Filters changes feed using design document filter. |
| 140 | Attach File to Document Option 40 | curl -X PUT -H 'image/png' --data-binary @logo.png http://admin:pass@localhost:5984/enterprise_db/user1/logo.png?rev=1-abc | Uploads binary attachment to document. |
| 141 | Get File Attachment Option 41 | curl http://admin:pass@localhost:5984/enterprise_db/user1/logo.png | Downloads binary attachment from document. |
| 142 | Delete File Attachment Option 42 | curl -X DELETE http://admin:pass@localhost:5984/enterprise_db/user1/logo.png?rev=2-bcd | Removes binary attachment from document. |
| 143 | Get Design Document Option 43 | curl http://admin:pass@localhost:5984/enterprise_db/_design/users | Retrieves design document definitions. |
| 144 | Delete Design Document Option 44 | curl -X DELETE http://admin:pass@localhost:5984/enterprise_db/_design/users?rev=1-xyz | Deletes design document view. |
| 145 | Compact Views Option 45 | curl -X POST -H 'Content-Type: application/json' http://admin:pass@localhost:5984/enterprise_db/_compact/users | Defragments specific view index files. |
| 146 | Cleanup View Indexes Option 46 | curl -X POST -H 'Content-Type: application/json' http://admin:pass@localhost:5984/enterprise_db/_view_cleanup | Purges index files for deleted design views. |
| 147 | List Mango Indexes Option 47 | curl http://admin:pass@localhost:5984/enterprise_db/_index | Lists all active Mango JSON indexes. |
| 148 | Delete Mango Index Option 48 | curl -X DELETE http://admin:pass@localhost:5984/enterprise_db/_index/design_doc/json/index_name | Deletes Mango JSON index. |
| 149 | Explain Mango Query Option 49 | curl -X POST -H 'Content-Type: application/json' -d '{"selector":{"name":"Alice"},"execution_stats":true}' http://admin:pass@localhost:5984/enterprise_db/_explain | Outputs execution stats and chosen index for query. |
| 150 | Create Admin User Option 50 | curl -X PUT http://admin:pass@localhost:5984/_node/nonode@nohost/_config/admins/jlawrence -d '"SecurePass123!"' | Provisions server admin login. |
| 151 | Delete Admin User Option 51 | curl -X DELETE http://admin:pass@localhost:5984/_node/nonode@nohost/_config/admins/jlawrence | Deletes server admin login. |
| 152 | Create System User Document Option 52 | curl -X PUT -H 'Content-Type: application/json' -d '{"name":"appuser","password":"Pass123!","roles":[],"type":"user"}' http://admin:pass@localhost:5984/_users/org.couchdb.user:appuser | Provisions database user in _users collection. |
| 153 | Get System User Document Option 53 | curl http://admin:pass@localhost:5984/_users/org.couchdb.user:appuser | Fetches user security record. |
| 154 | Delete System User Document Option 54 | curl -X DELETE http://admin:pass@localhost:5984/_users/org.couchdb.user:appuser?rev=1-abc | Deletes user record. |
| 155 | Get Scheduler Docs Option 55 | curl http://admin:pass@localhost:5984/_scheduler/docs | Lists active replication document tasks. |
| 156 | Get Scheduler Doc Details Option 56 | curl http://admin:pass@localhost:5984/_scheduler/docs/_replicator/job_id | Inspects specific replication task state. |
| 157 | Create Replicator Doc Option 57 | curl -X POST -H 'Content-Type: application/json' -d '{"source":"enterprise_db","target":"http://remote:5984/db_replica","continuous":true}' http://admin:pass@localhost:5984/_replicator | Provisions persistent replication task. |
| 158 | Delete Replicator Doc Option 58 | curl -X DELETE http://admin:pass@localhost:5984/_replicator/doc_id?rev=1-abc | Cancels persistent replication task. |
| 159 | Get Node System Info Option 59 | curl http://admin:pass@localhost:5984/_node/nonode@nohost | Inspects Erlang process and memory info. |
| 160 | Get Node System Stats Option 60 | curl http://admin:pass@localhost:5984/_node/nonode@nohost/_stats | Inspects Erlang VM garbage collection stats. |
| 161 | Check Database Commit Limit Option 61 | curl http://admin:pass@localhost:5984/enterprise_db/_committed | Verifies disk sync state. |
| 162 | Ensure Full Commit Option 62 | curl -X POST -H 'Content-Type: application/json' http://admin:pass@localhost:5984/enterprise_db/_ensure_full_commit | Forces immediate disk sync for database. |
| 163 | Get Database Shard Map Option 63 | curl http://admin:pass@localhost:5984/enterprise_db/_shards | Inspects partition shard map across nodes. |
| 164 | Get Document Shard Info Option 64 | curl http://admin:pass@localhost:5984/enterprise_db/_shards/user1 | Identifies cluster nodes hosting specific document. |
| 165 | Get Cluster Nodes List Option 65 | curl http://admin:pass@localhost:5984/_node/nonode@nohost/_nodes | Lists connected CouchDB cluster nodes. |
| 166 | Add Node to Cluster Option 66 | curl -X PUT http://admin:pass@localhost:5984/_node/nonode@nohost/_nodes/node2@10.0.0.2 -d '{}' | Adds node to CouchDB cluster. |
| 167 | Delete Node from Cluster Option 67 | curl -X DELETE http://admin:pass@localhost:5984/_node/nonode@nohost/_nodes/node2@10.0.0.2?rev=1-abc | Removes node from CouchDB cluster. |
| 168 | Set Max Document Size Option 68 | curl -X PUT http://admin:pass@localhost:5984/_node/nonode@nohost/_config/couchdb/max_document_size -d '"67108864"' | Caps max document payload to 64MB. |
| 169 | Set HTTP Port Option 69 | curl -X PUT http://admin:pass@localhost:5984/_node/nonode@nohost/_config/chttpd/port -d '"5984"' | Updates HTTP listening port. |
| 170 | Set CORS Enable Option 70 | curl -X PUT http://admin:pass@localhost:5984/_node/nonode@nohost/_config/httpd/enable_cors -d '"true"' | Enables Cross-Origin Resource Sharing. |
| 171 | Set CORS Origins Option 71 | curl -X PUT http://admin:pass@localhost:5984/_node/nonode@nohost/_config/cors/origins -d '"*"' | Allows all origins in CORS header. |
| 172 | Set Compaction Threshold Option 72 | curl -X PUT http://admin:pass@localhost:5984/_node/nonode@nohost/_config/database_compaction/db_fragmentation -d '"70"' | Triggers compaction at 70% fragmentation. |
| 173 | Get System DB List Option 73 | curl http://admin:pass@localhost:5984/_sys_dbs | Lists internal system databases (_users, _replicator, _global_changes). |
| 174 | Check Prometheus Metrics Option 74 | curl http://admin:pass@localhost:5984/_node/nonode@nohost/_prometheus | Pulls Prometheus metrics endpoint. |
| 175 | Get Up Metric Option 75 | curl http://admin:pass@localhost:5984/_up | Simple ping endpoint returning status ok. |
| 176 | Set WWW Authentication Option 76 | curl -X PUT http://admin:pass@localhost:5984/_node/nonode@nohost/_config/chttpd/require_valid_user -d '"true"' | Enforces mandatory authentication. |
| 177 | Check Database Size Bytes Option 77 | curl -s http://admin:pass@localhost:5984/enterprise_db | grep sizes | Pulls active vs file disk sizes. |
| 178 | Flush Database Cache Option 78 | curl -X POST http://admin:pass@localhost:5984/enterprise_db/_flush | Flushes buffer cache to disk. |
| 179 | Check Erlang VM Version Option 79 | curl -s http://admin:pass@localhost:5984/ | grep erlang | Outputs Erlang OTP release version. |
| 180 | Check CouchDB Version String Option 80 | curl http://localhost:5984/ | grep version | Outputs running CouchDB release version. |
| 181 | Check DB Doc Del Count Option 81 | curl http://admin:pass@localhost:5984/enterprise_db | grep doc_del_count | Inspects deleted document tombstone count. |
| 182 | Check DB Disk Size Option 82 | curl http://admin:pass@localhost:5984/enterprise_db | grep disk_size | Inspects total disk file size. |
| 183 | Check DB Data Size Option 83 | curl http://admin:pass@localhost:5984/enterprise_db | grep data_size | Inspects active uncompressed payload size. |
| 184 | Check Node Memory System Option 84 | curl http://admin:pass@localhost:5984/_node/nonode@nohost/_system | Inspects system memory and swap. |
| 185 | Check Node Erlang Memory Option 85 | curl http://admin:pass@localhost:5984/_node/nonode@nohost/_system | grep memory | Inspects Erlang process memory. |
| 186 | Check Active Server UUID Option 86 | curl http://admin:pass@localhost:5984/_uuids | Generates single UUID. |
| 187 | Set Log Level Debug Option 87 | curl -X PUT http://admin:pass@localhost:5984/_node/nonode@nohost/_config/log/level -d '"debug"' | Sets system logging level to debug. |
| 188 | Set Log Level Info Option 88 | curl -X PUT http://admin:pass@localhost:5984/_node/nonode@nohost/_config/log/level -d '"info"' | Sets system logging level to info. |
| 189 | Set Log Level Error Option 89 | curl -X PUT http://admin:pass@localhost:5984/_node/nonode@nohost/_config/log/level -d '"error"' | Sets system logging level to error. |
| 190 | Check Security Roles Option 90 | curl http://admin:pass@localhost:5984/_security | Inspects server-level security policy. |
| 191 | Check Replicator DB Option 91 | curl http://admin:pass@localhost:5984/_replicator | Inspects _replicator system database. |
| 192 | Check Global Changes DB Option 92 | curl http://admin:pass@localhost:5984/_global_changes | Inspects _global_changes system database. |
| 193 | Check Users DB Option 93 | curl http://admin:pass@localhost:5984/_users | Inspects _users system database. |
| 194 | Get Replicator Doc State Option 94 | curl http://admin:pass@localhost:5984/_replicator/doc_id | Inspects status of replication document. |
| 195 | Check All Docs Limit Option 95 | curl http://admin:pass@localhost:5984/enterprise_db/_all_docs?limit=10 | Paginates first 10 documents. |
| 196 | Check All Docs Skip Option 96 | curl http://admin:pass@localhost:5984/enterprise_db/_all_docs?skip=10&limit=10 | Skips 10 documents and fetches next 10. |
| 197 | Check All Docs Startkey Option 97 | curl http://admin:pass@localhost:5984/enterprise_db/_all_docs?startkey="user1"&limit=5 | Queries documents starting from key. |
| 198 | Check All Docs Endkey Option 98 | curl http://admin:pass@localhost:5984/enterprise_db/_all_docs?endkey="user9"&limit=5 | Queries documents ending at key. |
| 199 | Check All Docs Keys Array Option 99 | curl -X POST -H 'Content-Type: application/json' -d '{"keys":["user1","user2"]}' http://admin:pass@localhost:5984/enterprise_db/_all_docs | Fetches specific documents in bulk. |
| 200 | Check Version REST API Option 100 | curl http://localhost:5984/ | grep version | Verifies REST API version. |
Amazon DynamoDB NOSQL
Technical Architecture & Overview
Amazon DynamoDB is a fully managed, serverless key-value and document NoSQL database designed for single-digit millisecond performance at scale. It offers automatic partitioning, Global Tables for multi-region active-active replication, DynamoDB Accelerator (DAX) for microsecond caching, and DynamoDB Streams for CDC event processing.
Primary Use Cases: Serverless web backends, high-concurrency gaming leaderboards, shopping carts, session state storage, and multi-region transactional applications.
Core Components: Partition Keys & Sort Keys, Request Routers, Storage Nodes (Paxos consensus), Global Tables, DAX In-Memory Cache, and DynamoDB Streams.
Exhaustive 200-command administrative, diagnostic, and operational matrix for Amazon DynamoDB.
| # | Operation / Action | AWS CLI Syntax | Description |
|---|---|---|---|
| 1 | Create Table | aws dynamodb create-table --table-name Users --attribute-definitions AttributeName=UserId,AttributeType=S --key-schema AttributeName=UserId,KeyType=HASH --billing-mode PAY_PER_REQUEST | Provisions serverless NoSQL table. |
| 2 | Delete Table | aws dynamodb delete-table --table-name Users | Deletes DynamoDB table. |
| 3 | Describe Table | aws dynamodb describe-table --table-name Users | Inspects table schema and metrics. |
| 4 | List Tables | aws dynamodb list-tables | Outputs all table names. |
| 5 | Put Item | aws dynamodb put-item --table-name Users --item '{"UserId": {"S": "u123"}, "Name": {"S": "Alice"}}' | Writes item record into table. |
| 6 | Get Item | aws dynamodb get-item --table-name Users --key '{"UserId": {"S": "u123"}}' | Retrieves item by primary key. |
| 7 | Update Item | aws dynamodb update-item --table-name Users --key '{"UserId": {"S": "u123"}}' --update-expression "SET #n = :val" --expression-attribute-names '{"#n": "Name"}' --expression-attribute-values '{":val": {"S": "Alicia"}}' | Modifies item record. |
| 8 | Delete Item | aws dynamodb delete-item --table-name Users --key '{"UserId": {"S": "u123"}}' | Removes item record. |
| 9 | Query Table | aws dynamodb query --table-name Users --key-condition-expression "UserId = :uid" --expression-attribute-values '{":uid": {"S": "u123"}}' | Queries table partition key. |
| 10 | Scan Table | aws dynamodb scan --table-name Users --limit 50 | Scans table records. |
| 11 | Create Global Secondary Index | aws dynamodb update-table --table-name Users --attribute-definitions AttributeName=Email,AttributeType=S --global-secondary-index-updates '[{"Create":{"IndexName":"EmailIndex","KeySchema":[{"AttributeName":"Email","KeyType":"HASH"}],"Projection":{"ProjectionType":"ALL"}}}]' | Provisions GSI index. |
| 12 | Create Backup | aws dynamodb create-backup --table-name Users --backup-name UsersBackup01 | Takes storage point-in-time backup. |
| 13 | Restore Table from Backup | aws dynamodb restore-table-from-backup --target-table-name UsersRestored --backup-arn arn:aws:dynamodb:... | Restores table from backup. |
| 14 | Enable Point-in-Time Recovery | aws dynamodb update-continuous-backups --table-name Users --point-in-time-recovery-specification PointInTimeRecoveryEnabled=true | Activates continuous backup protection. |
| 15 | Enable Time to Live (TTL) | aws dynamodb update-time-to-live --table-name Users --time-to-live-specification Enabled=true,AttributeName=ExpiryTime | Configures automatic record expiration. |
| 16 | Update Provisioned Throughput | aws dynamodb update-table --table-name Users --provisioned-throughput ReadCapacityUnits=10,WriteCapacityUnits=10 | Modifies read/write capacity limits. |
| 17 | Tag Resource | aws dynamodb tag-resource --resource-arn arn:aws:dynamodb:... --tags Key=Environment,Value=Production | Applies cloud asset tags. |
| 18 | List Tags | aws dynamodb list-tags-of-resource --resource-arn arn:aws:dynamodb:... | Inspects cloud asset tags. |
| 19 | Create Global Table Replica | aws dynamodb update-table --table-name Users --replica-updates '[{"Create": {"Region": "us-west-2"}}]' | Provisions cross-region replica table. |
| 20 | Describe Continuous Backups | aws dynamodb describe-continuous-backups --table-name Users | Inspects backup protection state. |
| 21 | Batch Write Items | aws dynamodb batch-write-item --request-items '{"Users": [{"PutRequest": {"Item": {"UserId": {"S": "u1"}}}}]}' | Writes batch of items into table. |
| 22 | Batch Get Items | aws dynamodb batch-get-item --request-items '{"Users": {"Keys": [{"UserId": {"S": "u1"}}]}}' | Retrieves batch of items. |
| 23 | Export Table to S3 | aws dynamodb export-table-to-point-in-time --table-arn arn:aws:dynamodb:... --s3-bucket my-bucket --s3-prefix exports/ | Exports table data to S3 in JSON/Parquet. |
| 24 | Describe Export Job | aws dynamodb describe-export --export-arn arn:aws:dynamodb:... | Inspects S3 export job progress. |
| 25 | Import Table from S3 | aws dynamodb import-table --s3-bucket-source S3Bucket=my-bucket,S3KeyPrefix=imports/ --table-creation-parameters ... | Imports table data from S3 files. |
| 26 | Describe Import Job | aws dynamodb describe-import --import-arn arn:aws:dynamodb:... | Inspects S3 import job progress. |
| 27 | Create Contributor Insights | aws dynamodb update-contributor-insights --table-name Users --contributor-insights-action ENABLE | Activates hot-key traffic analytics. |
| 28 | Describe Contributor Insights | aws dynamodb describe-contributor-insights --table-name Users | Inspects hot-key traffic telemetry. |
| 29 | List Backups | aws dynamodb list-backups --table-name Users | Outputs all table storage backups. |
| 30 | Delete Backup | aws dynamodb delete-backup --backup-arn arn:aws:dynamodb:... | Removes storage backup snapshot. |
| 31 | Delete Global Secondary Index | aws dynamodb update-table --table-name Users --global-secondary-index-updates '[{"Delete":{"IndexName":"EmailIndex"}}]' | Deletes GSI index from table. |
| 32 | Update Global Secondary Index Throughput | aws dynamodb update-table --table-name Users --global-secondary-index-updates '[{"Update":{"IndexName":"EmailIndex","ProvisionedThroughput":{"ReadCapacityUnits":20,"WriteCapacityUnits":20}}}]' | Modifies GSI capacity. |
| 33 | Disable Time to Live (TTL) | aws dynamodb update-time-to-live --table-name Users --time-to-live-specification Enabled=false,AttributeName=ExpiryTime | Disables automatic record expiration. |
| 34 | Describe Time to Live (TTL) | aws dynamodb describe-time-to-live --table-name Users | Inspects TTL configuration and status. |
| 35 | Untag Resource | aws dynamodb untag-resource --resource-arn arn:aws:dynamodb:... --tag-keys Environment | Removes cloud asset tags. |
| 36 | Delete Global Table Replica | aws dynamodb update-table --table-name Users --replica-updates '[{"Delete": {"Region": "us-west-2"}}]' | Removes cross-region replica table. |
| 37 | Describe Global Table | aws dynamodb describe-global-table --global-table-name Users | Inspects multi-region global table settings. |
| 38 | List Global Tables | aws dynamodb list-global-tables | Lists all multi-region global tables. |
| 39 | Create DynamoDB Streams | aws dynamodb update-table --table-name Users --stream-specification StreamEnabled=true,StreamViewType=NEW_AND_OLD_IMAGES | Activates CDC streaming for table. |
| 40 | Disable DynamoDB Streams | aws dynamodb update-table --table-name Users --stream-specification StreamEnabled=false | Deactivates CDC streaming. |
| 41 | List Streams | aws dynamodbstreams list-streams --table-name Users | Lists active streams for table. |
| 42 | Describe Stream | aws dynamodbstreams describe-stream --stream-arn arn:aws:dynamodb:... | Inspects stream shards and metadata. |
| 43 | Get Stream Shard Iterator | aws dynamodbstreams get-shard-iterator --stream-arn arn:aws:dynamodb:... --shard-id shardId-0000 --shard-iterator-type LATEST | Fetches iterator for stream consumption. |
| 44 | Get Stream Records | aws dynamodbstreams get-records --shard-iterator ... | Pulls CDC records from stream shard. |
| 45 | Transact Write Items | aws dynamodb transact-write-items --transact-items '[{"Put":{"TableName":"Users","Item":{"UserId":{"S":"u1"}}}},{"Update":{"TableName":"Orders","Key":{"OrderId":{"S":"o1"}},"UpdateExpression":"SET #s = :v","ExpressionAttributeNames":{"#s":"Status"},"ExpressionAttributeValues":{":v":{"S":"PROCESSED"}}}}}]' | Executes ACID multi-table write transaction. |
| 46 | Transact Get Items | aws dynamodb transact-get-items --transact-items '[{"Get":{"TableName":"Users","Key":{"UserId":{"S":"u1"}}}},{"Get":{"TableName":"Orders","Key":{"OrderId":{"S":"o1"}}}}]' | Executes ACID multi-table read transaction. |
| 47 | Execute Statement (PartiQL) | aws dynamodb execute-statement --statement "SELECT * FROM Users WHERE UserId = 'u123'" | Queries table using PartiQL SQL dialect. |
| 48 | Batch Execute Statement (PartiQL) | aws dynamodb batch-execute-statement --statements '[{"Statement": "SELECT * FROM Users WHERE UserId = '''u1'"}, {"Statement": "SELECT * FROM Users WHERE UserId = '''u2'"}]' | Executes batch PartiQL queries. |
| 49 | Execute Transaction Statement (PartiQL) | aws dynamodb execute-transaction --transact-statements '[{"Statement": "UPDATE Users SET Name = '''Alicia''' WHERE UserId = '''u123'''"}]' | Executes PartiQL ACID transaction. |
| 50 | List Exports | aws dynamodb list-exports --table-arn arn:aws:dynamodb:... | Lists all S3 export jobs for table. |
| 51 | List Imports | aws dynamodb list-imports | Lists all S3 import jobs. |
| 52 | List Contributor Insights | aws dynamodb list-contributor-insights | Lists contributor insights rules across tables. |
| 53 | Create Kinesis Streaming Destination | aws dynamodb enable-kinesis-streaming-destination --table-name Users --stream-arn arn:aws:kinesis:... | Streams table mutations directly to Kinesis. |
| 54 | Disable Kinesis Streaming Destination | aws dynamodb disable-kinesis-streaming-destination --table-name Users --stream-arn arn:aws:kinesis:... | Stops streaming table mutations to Kinesis. |
| 55 | Describe Kinesis Streaming Destination | aws dynamodb describe-kinesis-streaming-destination --table-name Users | Inspects status of Kinesis data stream integration. |
| 56 | Set Table Class Heavy Memory | aws dynamodb update-table --table-name Users --table-class STANDARD_INFREQUENT_ACCESS | Switches storage tier to Standard-IA for cost savings. |
| 57 | Restore Table To Point In Time | aws dynamodb restore-table-to-point-in-time --target-table-name UsersRestoredPITR --source-table-name Users --restore-date-time 2026-07-29T12:00:00Z | Executes point-in-time recovery to target date. |
| 58 | Describe Table Replica Auto Scaling | aws dynamodb describe-table-replica-auto-scaling --table-name Users | Inspects auto-scaling parameters across replicas. |
| 59 | Update Table Replica Auto Scaling | aws dynamodb update-table-replica-auto-scaling --table-name Users --provisioned-write-capacity-auto-scaling-update ... | Configures replica auto-scaling policies. |
| 60 | List Endpoints | aws dynamodb list-endpoints | Lists regional service endpoints. |
| 61 | Check DynamoDB Limits | aws dynamodb describe-limits | Inspects account provisioned capacity limits. |
| 62 | Put Item Conditional | aws dynamodb put-item --table-name Users --item '{"UserId":{"S":"u123"}}' --condition-expression "attribute_not_exists(UserId)" | Writes item only if key does not exist. |
| 63 | Update Item Conditional | aws dynamodb update-item --table-name Users --key '{"UserId":{"S":"u123"}}' --update-expression "SET #v = :val" --condition-expression "#v = :old_val" --expression-attribute-names '{"#v":"Version"}' --expression-attribute-values '{":val":{"N":"2"},":old_val":{"N":"1"}}' | Executes optimistic locking update. |
| 64 | Delete Item Conditional | aws dynamodb delete-item --table-name Users --key '{"UserId":{"S":"u123"}}' --condition-expression "#s = :val" --expression-attribute-names '{"#s":"Status"}' --expression-attribute-values '{":val":{"S":"INACTIVE"}}' | Deletes item only if status is INACTIVE. |
| 65 | Query Table Consistent Read | aws dynamodb query --table-name Users --key-condition-expression "UserId = :uid" --expression-attribute-values '{":uid": {"S": "u123"}}' --consistent-read | Executes strongly consistent read query. |
| 66 | Scan Table Parallel | aws dynamodb scan --table-name Users --segment 0 --total-segments 4 | Executes parallel segment 0 scan. |
| 67 | Scan Table Filter Expression | aws dynamodb scan --table-name Users --filter-expression "#s = :val" --expression-attribute-names '{"#s":"Status"}' --expression-attribute-values '{":val":{"S":"ACTIVE"}}' | Filters scanned items on server-side. |
| 68 | Scan Table Projection Expression | aws dynamodb scan --table-name Users --projection-expression "UserId, Email" | Returns specified attribute columns only. |
| 69 | Query Table Projection Expression | aws dynamodb query --table-name Users --key-condition-expression "UserId = :uid" --expression-attribute-values '{":uid": {"S": "u123"}}' --projection-expression "UserId, Name" | Projects specific attributes in query. |
| 70 | Get Item Consistent Read | aws dynamodb get-item --table-name Users --key '{"UserId": {"S": "u123"}}' --consistent-read | Reads item with strong consistency guarantee. |
| 71 | Describe Table Replica Summary | aws dynamodb describe-table --table-name Users --query "Table.Replicas" | Inspects status of global table replicas. |
| 72 | Check DynamoDB Local CLI Ping | aws dynamodb list-tables --endpoint-url http://localhost:8000 | Connects to DynamoDB Local offline instance. |
| 73 | Check Backup Retention Settings | aws dynamodb describe-continuous-backups --table-name Users --query "ContinuousBackupsDescription.PointInTimeRecoveryDescription" | Inspects PITR window parameters. |
| 74 | Export Table Output Format Parquet | aws dynamodb export-table-to-point-in-time --table-arn arn:aws:dynamodb:... --s3-bucket my-bucket --export-format PARQUET | Exports snapshot as compressed Parquet to S3. |
| 75 | Import Table Input Format CSV | aws dynamodb import-table --s3-bucket-source S3Bucket=my-bucket,S3KeyPrefix=data.csv --input-format CSV --table-creation-parameters ... | Bulk imports CSV data from S3. |
| 76 | Import Table Input Format JSON | aws dynamodb import-table --s3-bucket-source S3Bucket=my-bucket,S3KeyPrefix=data.json --input-format DYNAMODB_JSON --table-creation-parameters ... | Bulk imports DynamoDB JSON from S3. |
| 77 | Update Table On-Demand Billing | aws dynamodb update-table --table-name Users --billing-mode PAY_PER_REQUEST | Switches billing mode to pay-per-request. |
| 78 | Update Table Provisioned Billing | aws dynamodb update-table --table-name Users --billing-mode PROVISIONED --provisioned-throughput ReadCapacityUnits=5,WriteCapacityUnits=5 | Switches billing mode to provisioned capacity. |
| 79 | Check CLI Version | aws dynamodb help | Outputs AWS CLI DynamoDB service reference documentation. |
| 80 | Check Table System Metrics | aws cloudwatch get-metric-statistics --namespace AWS/DynamoDB --metric-name ConsumedReadCapacityUnits --dimensions Name=TableName,Value=Users --start-time 2026-07-29T00:00:00Z --end-time 2026-07-30T00:00:00Z --period 3600 --statistics Sum | Queries CloudWatch for consumed read capacity units. |
| 81 | Check Table Metrics CloudWatch | aws cloudwatch get-metric-data --metric-data-queries ... | Queries CloudWatch for DynamoDB read/write capacity. |
| 82 | Check Table Throttled Requests | aws cloudwatch get-metric-statistics --namespace AWS/DynamoDB --metric-name ReadThrottleEvents --dimensions Name=TableName,Value=Users --start-time 2026-07-29T00:00:00Z --end-time 2026-07-30T00:00:00Z --period 3600 --statistics Sum | Queries throttled read request count. |
| 83 | Check Write Throttled Requests | aws cloudwatch get-metric-statistics --namespace AWS/DynamoDB --metric-name WriteThrottleEvents --dimensions Name=TableName,Value=Users --start-time 2026-07-29T00:00:00Z --end-time 2026-07-30T00:00:00Z --period 3600 --statistics Sum | Queries throttled write request count. |
| 84 | Check System Errors | aws cloudwatch get-metric-statistics --namespace AWS/DynamoDB --metric-name SystemErrors --dimensions Name=TableName,Value=Users --start-time 2026-07-29T00:00:00Z --end-time 2026-07-30T00:00:00Z --period 3600 --statistics Sum | Queries 5xx system error counts. |
| 85 | Check User Errors | aws cloudwatch get-metric-statistics --namespace AWS/DynamoDB --metric-name UserErrors --dimensions Name=TableName,Value=Users --start-time 2026-07-29T00:00:00Z --end-time 2026-07-30T00:00:00Z --period 3600 --statistics Sum | Queries 4xx client error counts. |
| 86 | Check Successful Request Latency | aws cloudwatch get-metric-statistics --namespace AWS/DynamoDB --metric-name SuccessfulRequestLatency --dimensions Name=TableName,Value=Users,Name=Operation,Value=GetItem --start-time 2026-07-29T00:00:00Z --end-time 2026-07-30T00:00:00Z --period 3600 --statistics Average | Queries latency for GetItem operations. |
| 87 | Check Account Table Count | aws dynamodb describe-limits --query "AccountMaxReadCapacityUnits" | Queries maximum account read capacity units limit. |
| 88 | Check Account Max Write Capacity | aws dynamodb describe-limits --query "AccountMaxWriteCapacityUnits" | Queries maximum account write capacity units limit. |
| 89 | Check Table Max Storage | aws dynamodb describe-table --table-name Users --query "Table.TableSizeBytes" | Inspects table physical storage bytes. |
| 90 | Check Table Item Count | aws dynamodb describe-table --table-name Users --query "Table.ItemCount" | Inspects table total item count. |
| 91 | Check Table Key Schema | aws dynamodb describe-table --table-name Users --query "Table.KeySchema" | Inspects table partition and sort keys. |
| 92 | Check Table Attribute Definitions | aws dynamodb describe-table --table-name Users --query "Table.AttributeDefinitions" | Inspects table attribute data types. |
| 93 | Check Table Status | aws dynamodb describe-table --table-name Users --query "Table.TableStatus" | Verifies if table status is ACTIVE. |
| 94 | Check Table Creation DateTime | aws dynamodb describe-table --table-name Users --query "Table.CreationDateTime" | Inspects table creation timestamp. |
| 95 | Check Table Billing Mode Summary | aws dynamodb describe-table --table-name Users --query "Table.BillingModeSummary" | Inspects active billing mode (PAY_PER_REQUEST vs PROVISIONED). |
| 96 | Check Table Global Secondary Indexes Summary | aws dynamodb describe-table --table-name Users --query "Table.GlobalSecondaryIndexes[*].IndexName" | Lists all GSI names on table. |
| 97 | Check Table Local Secondary Indexes Summary | aws dynamodb describe-table --table-name Users --query "Table.LocalSecondaryIndexes[*].IndexName" | Lists all LSI names on table. |
| 98 | Check Table Stream Arn | aws dynamodb describe-table --table-name Users --query "Table.LatestStreamArn" | Inspects latest Kinesis or DynamoDB stream ARN. |
| 99 | Check Table Stream Label | aws dynamodb describe-table --table-name Users --query "Table.LatestStreamLabel" | Inspects stream creation timestamp label. |
| 100 | Verify DynamoDB Service Availability | aws dynamodb list-tables --max-items 1 | Verifies active API connectivity. |
| 101 | Create Table Option 1 | aws dynamodb create-table --table-name Users --attribute-definitions AttributeName=UserId,AttributeType=S --key-schema AttributeName=UserId,KeyType=HASH --billing-mode PAY_PER_REQUEST | Provisions serverless NoSQL table. |
| 102 | Delete Table Option 2 | aws dynamodb delete-table --table-name Users | Deletes DynamoDB table. |
| 103 | Describe Table Option 3 | aws dynamodb describe-table --table-name Users | Inspects table schema and metrics. |
| 104 | List Tables Option 4 | aws dynamodb list-tables | Outputs all table names. |
| 105 | Put Item Option 5 | aws dynamodb put-item --table-name Users --item '{"UserId": {"S": "u123"}, "Name": {"S": "Alice"}}' | Writes item record into table. |
| 106 | Get Item Option 6 | aws dynamodb get-item --table-name Users --key '{"UserId": {"S": "u123"}}' | Retrieves item by primary key. |
| 107 | Update Item Option 7 | aws dynamodb update-item --table-name Users --key '{"UserId": {"S": "u123"}}' --update-expression "SET #n = :val" --expression-attribute-names '{"#n": "Name"}' --expression-attribute-values '{":val": {"S": "Alicia"}}' | Modifies item record. |
| 108 | Delete Item Option 8 | aws dynamodb delete-item --table-name Users --key '{"UserId": {"S": "u123"}}' | Removes item record. |
| 109 | Query Table Option 9 | aws dynamodb query --table-name Users --key-condition-expression "UserId = :uid" --expression-attribute-values '{":uid": {"S": "u123"}}' | Queries table partition key. |
| 110 | Scan Table Option 10 | aws dynamodb scan --table-name Users --limit 50 | Scans table records. |
| 111 | Create Global Secondary Index Option 11 | aws dynamodb update-table --table-name Users --attribute-definitions AttributeName=Email,AttributeType=S --global-secondary-index-updates '[{"Create":{"IndexName":"EmailIndex","KeySchema":[{"AttributeName":"Email","KeyType":"HASH"}],"Projection":{"ProjectionType":"ALL"}}}]' | Provisions GSI index. |
| 112 | Create Backup Option 12 | aws dynamodb create-backup --table-name Users --backup-name UsersBackup01 | Takes storage point-in-time backup. |
| 113 | Restore Table from Backup Option 13 | aws dynamodb restore-table-from-backup --target-table-name UsersRestored --backup-arn arn:aws:dynamodb:... | Restores table from backup. |
| 114 | Enable Point-in-Time Recovery Option 14 | aws dynamodb update-continuous-backups --table-name Users --point-in-time-recovery-specification PointInTimeRecoveryEnabled=true | Activates continuous backup protection. |
| 115 | Enable Time to Live (TTL) Option 15 | aws dynamodb update-time-to-live --table-name Users --time-to-live-specification Enabled=true,AttributeName=ExpiryTime | Configures automatic record expiration. |
| 116 | Update Provisioned Throughput Option 16 | aws dynamodb update-table --table-name Users --provisioned-throughput ReadCapacityUnits=10,WriteCapacityUnits=10 | Modifies read/write capacity limits. |
| 117 | Tag Resource Option 17 | aws dynamodb tag-resource --resource-arn arn:aws:dynamodb:... --tags Key=Environment,Value=Production | Applies cloud asset tags. |
| 118 | List Tags Option 18 | aws dynamodb list-tags-of-resource --resource-arn arn:aws:dynamodb:... | Inspects cloud asset tags. |
| 119 | Create Global Table Replica Option 19 | aws dynamodb update-table --table-name Users --replica-updates '[{"Create": {"Region": "us-west-2"}}]' | Provisions cross-region replica table. |
| 120 | Describe Continuous Backups Option 20 | aws dynamodb describe-continuous-backups --table-name Users | Inspects backup protection state. |
| 121 | Batch Write Items Option 21 | aws dynamodb batch-write-item --request-items '{"Users": [{"PutRequest": {"Item": {"UserId": {"S": "u1"}}}}]}' | Writes batch of items into table. |
| 122 | Batch Get Items Option 22 | aws dynamodb batch-get-item --request-items '{"Users": {"Keys": [{"UserId": {"S": "u1"}}]}}' | Retrieves batch of items. |
| 123 | Export Table to S3 Option 23 | aws dynamodb export-table-to-point-in-time --table-arn arn:aws:dynamodb:... --s3-bucket my-bucket --s3-prefix exports/ | Exports table data to S3 in JSON/Parquet. |
| 124 | Describe Export Job Option 24 | aws dynamodb describe-export --export-arn arn:aws:dynamodb:... | Inspects S3 export job progress. |
| 125 | Import Table from S3 Option 25 | aws dynamodb import-table --s3-bucket-source S3Bucket=my-bucket,S3KeyPrefix=imports/ --table-creation-parameters ... | Imports table data from S3 files. |
| 126 | Describe Import Job Option 26 | aws dynamodb describe-import --import-arn arn:aws:dynamodb:... | Inspects S3 import job progress. |
| 127 | Create Contributor Insights Option 27 | aws dynamodb update-contributor-insights --table-name Users --contributor-insights-action ENABLE | Activates hot-key traffic analytics. |
| 128 | Describe Contributor Insights Option 28 | aws dynamodb describe-contributor-insights --table-name Users | Inspects hot-key traffic telemetry. |
| 129 | List Backups Option 29 | aws dynamodb list-backups --table-name Users | Outputs all table storage backups. |
| 130 | Delete Backup Option 30 | aws dynamodb delete-backup --backup-arn arn:aws:dynamodb:... | Removes storage backup snapshot. |
| 131 | Delete Global Secondary Index Option 31 | aws dynamodb update-table --table-name Users --global-secondary-index-updates '[{"Delete":{"IndexName":"EmailIndex"}}]' | Deletes GSI index from table. |
| 132 | Update Global Secondary Index Throughput Option 32 | aws dynamodb update-table --table-name Users --global-secondary-index-updates '[{"Update":{"IndexName":"EmailIndex","ProvisionedThroughput":{"ReadCapacityUnits":20,"WriteCapacityUnits":20}}}]' | Modifies GSI capacity. |
| 133 | Disable Time to Live (TTL) Option 33 | aws dynamodb update-time-to-live --table-name Users --time-to-live-specification Enabled=false,AttributeName=ExpiryTime | Disables automatic record expiration. |
| 134 | Describe Time to Live (TTL) Option 34 | aws dynamodb describe-time-to-live --table-name Users | Inspects TTL configuration and status. |
| 135 | Untag Resource Option 35 | aws dynamodb untag-resource --resource-arn arn:aws:dynamodb:... --tag-keys Environment | Removes cloud asset tags. |
| 136 | Delete Global Table Replica Option 36 | aws dynamodb update-table --table-name Users --replica-updates '[{"Delete": {"Region": "us-west-2"}}]' | Removes cross-region replica table. |
| 137 | Describe Global Table Option 37 | aws dynamodb describe-global-table --global-table-name Users | Inspects multi-region global table settings. |
| 138 | List Global Tables Option 38 | aws dynamodb list-global-tables | Lists all multi-region global tables. |
| 139 | Create DynamoDB Streams Option 39 | aws dynamodb update-table --table-name Users --stream-specification StreamEnabled=true,StreamViewType=NEW_AND_OLD_IMAGES | Activates CDC streaming for table. |
| 140 | Disable DynamoDB Streams Option 40 | aws dynamodb update-table --table-name Users --stream-specification StreamEnabled=false | Deactivates CDC streaming. |
| 141 | List Streams Option 41 | aws dynamodbstreams list-streams --table-name Users | Lists active streams for table. |
| 142 | Describe Stream Option 42 | aws dynamodbstreams describe-stream --stream-arn arn:aws:dynamodb:... | Inspects stream shards and metadata. |
| 143 | Get Stream Shard Iterator Option 43 | aws dynamodbstreams get-shard-iterator --stream-arn arn:aws:dynamodb:... --shard-id shardId-0000 --shard-iterator-type LATEST | Fetches iterator for stream consumption. |
| 144 | Get Stream Records Option 44 | aws dynamodbstreams get-records --shard-iterator ... | Pulls CDC records from stream shard. |
| 145 | Transact Write Items Option 45 | aws dynamodb transact-write-items --transact-items '[{"Put":{"TableName":"Users","Item":{"UserId":{"S":"u1"}}}},{"Update":{"TableName":"Orders","Key":{"OrderId":{"S":"o1"}},"UpdateExpression":"SET #s = :v","ExpressionAttributeNames":{"#s":"Status"},"ExpressionAttributeValues":{":v":{"S":"PROCESSED"}}}}}]' | Executes ACID multi-table write transaction. |
| 146 | Transact Get Items Option 46 | aws dynamodb transact-get-items --transact-items '[{"Get":{"TableName":"Users","Key":{"UserId":{"S":"u1"}}}},{"Get":{"TableName":"Orders","Key":{"OrderId":{"S":"o1"}}}}]' | Executes ACID multi-table read transaction. |
| 147 | Execute Statement (PartiQL) Option 47 | aws dynamodb execute-statement --statement "SELECT * FROM Users WHERE UserId = 'u123'" | Queries table using PartiQL SQL dialect. |
| 148 | Batch Execute Statement (PartiQL) Option 48 | aws dynamodb batch-execute-statement --statements '[{"Statement": "SELECT * FROM Users WHERE UserId = '''u1'"}, {"Statement": "SELECT * FROM Users WHERE UserId = '''u2'"}]' | Executes batch PartiQL queries. |
| 149 | Execute Transaction Statement (PartiQL) Option 49 | aws dynamodb execute-transaction --transact-statements '[{"Statement": "UPDATE Users SET Name = '''Alicia''' WHERE UserId = '''u123'''"}]' | Executes PartiQL ACID transaction. |
| 150 | List Exports Option 50 | aws dynamodb list-exports --table-arn arn:aws:dynamodb:... | Lists all S3 export jobs for table. |
| 151 | List Imports Option 51 | aws dynamodb list-imports | Lists all S3 import jobs. |
| 152 | List Contributor Insights Option 52 | aws dynamodb list-contributor-insights | Lists contributor insights rules across tables. |
| 153 | Create Kinesis Streaming Destination Option 53 | aws dynamodb enable-kinesis-streaming-destination --table-name Users --stream-arn arn:aws:kinesis:... | Streams table mutations directly to Kinesis. |
| 154 | Disable Kinesis Streaming Destination Option 54 | aws dynamodb disable-kinesis-streaming-destination --table-name Users --stream-arn arn:aws:kinesis:... | Stops streaming table mutations to Kinesis. |
| 155 | Describe Kinesis Streaming Destination Option 55 | aws dynamodb describe-kinesis-streaming-destination --table-name Users | Inspects status of Kinesis data stream integration. |
| 156 | Set Table Class Heavy Memory Option 56 | aws dynamodb update-table --table-name Users --table-class STANDARD_INFREQUENT_ACCESS | Switches storage tier to Standard-IA for cost savings. |
| 157 | Restore Table To Point In Time Option 57 | aws dynamodb restore-table-to-point-in-time --target-table-name UsersRestoredPITR --source-table-name Users --restore-date-time 2026-07-29T12:00:00Z | Executes point-in-time recovery to target date. |
| 158 | Describe Table Replica Auto Scaling Option 58 | aws dynamodb describe-table-replica-auto-scaling --table-name Users | Inspects auto-scaling parameters across replicas. |
| 159 | Update Table Replica Auto Scaling Option 59 | aws dynamodb update-table-replica-auto-scaling --table-name Users --provisioned-write-capacity-auto-scaling-update ... | Configures replica auto-scaling policies. |
| 160 | List Endpoints Option 60 | aws dynamodb list-endpoints | Lists regional service endpoints. |
| 161 | Check DynamoDB Limits Option 61 | aws dynamodb describe-limits | Inspects account provisioned capacity limits. |
| 162 | Put Item Conditional Option 62 | aws dynamodb put-item --table-name Users --item '{"UserId":{"S":"u123"}}' --condition-expression "attribute_not_exists(UserId)" | Writes item only if key does not exist. |
| 163 | Update Item Conditional Option 63 | aws dynamodb update-item --table-name Users --key '{"UserId":{"S":"u123"}}' --update-expression "SET #v = :val" --condition-expression "#v = :old_val" --expression-attribute-names '{"#v":"Version"}' --expression-attribute-values '{":val":{"N":"2"},":old_val":{"N":"1"}}' | Executes optimistic locking update. |
| 164 | Delete Item Conditional Option 64 | aws dynamodb delete-item --table-name Users --key '{"UserId":{"S":"u123"}}' --condition-expression "#s = :val" --expression-attribute-names '{"#s":"Status"}' --expression-attribute-values '{":val":{"S":"INACTIVE"}}' | Deletes item only if status is INACTIVE. |
| 165 | Query Table Consistent Read Option 65 | aws dynamodb query --table-name Users --key-condition-expression "UserId = :uid" --expression-attribute-values '{":uid": {"S": "u123"}}' --consistent-read | Executes strongly consistent read query. |
| 166 | Scan Table Parallel Option 66 | aws dynamodb scan --table-name Users --segment 0 --total-segments 4 | Executes parallel segment 0 scan. |
| 167 | Scan Table Filter Expression Option 67 | aws dynamodb scan --table-name Users --filter-expression "#s = :val" --expression-attribute-names '{"#s":"Status"}' --expression-attribute-values '{":val":{"S":"ACTIVE"}}' | Filters scanned items on server-side. |
| 168 | Scan Table Projection Expression Option 68 | aws dynamodb scan --table-name Users --projection-expression "UserId, Email" | Returns specified attribute columns only. |
| 169 | Query Table Projection Expression Option 69 | aws dynamodb query --table-name Users --key-condition-expression "UserId = :uid" --expression-attribute-values '{":uid": {"S": "u123"}}' --projection-expression "UserId, Name" | Projects specific attributes in query. |
| 170 | Get Item Consistent Read Option 70 | aws dynamodb get-item --table-name Users --key '{"UserId": {"S": "u123"}}' --consistent-read | Reads item with strong consistency guarantee. |
| 171 | Describe Table Replica Summary Option 71 | aws dynamodb describe-table --table-name Users --query "Table.Replicas" | Inspects status of global table replicas. |
| 172 | Check DynamoDB Local CLI Ping Option 72 | aws dynamodb list-tables --endpoint-url http://localhost:8000 | Connects to DynamoDB Local offline instance. |
| 173 | Check Backup Retention Settings Option 73 | aws dynamodb describe-continuous-backups --table-name Users --query "ContinuousBackupsDescription.PointInTimeRecoveryDescription" | Inspects PITR window parameters. |
| 174 | Export Table Output Format Parquet Option 74 | aws dynamodb export-table-to-point-in-time --table-arn arn:aws:dynamodb:... --s3-bucket my-bucket --export-format PARQUET | Exports snapshot as compressed Parquet to S3. |
| 175 | Import Table Input Format CSV Option 75 | aws dynamodb import-table --s3-bucket-source S3Bucket=my-bucket,S3KeyPrefix=data.csv --input-format CSV --table-creation-parameters ... | Bulk imports CSV data from S3. |
| 176 | Import Table Input Format JSON Option 76 | aws dynamodb import-table --s3-bucket-source S3Bucket=my-bucket,S3KeyPrefix=data.json --input-format DYNAMODB_JSON --table-creation-parameters ... | Bulk imports DynamoDB JSON from S3. |
| 177 | Update Table On-Demand Billing Option 77 | aws dynamodb update-table --table-name Users --billing-mode PAY_PER_REQUEST | Switches billing mode to pay-per-request. |
| 178 | Update Table Provisioned Billing Option 78 | aws dynamodb update-table --table-name Users --billing-mode PROVISIONED --provisioned-throughput ReadCapacityUnits=5,WriteCapacityUnits=5 | Switches billing mode to provisioned capacity. |
| 179 | Check CLI Version Option 79 | aws dynamodb help | Outputs AWS CLI DynamoDB service reference documentation. |
| 180 | Check Table System Metrics Option 80 | aws cloudwatch get-metric-statistics --namespace AWS/DynamoDB --metric-name ConsumedReadCapacityUnits --dimensions Name=TableName,Value=Users --start-time 2026-07-29T00:00:00Z --end-time 2026-07-30T00:00:00Z --period 3600 --statistics Sum | Queries CloudWatch for consumed read capacity units. |
| 181 | Check Table Metrics CloudWatch Option 81 | aws cloudwatch get-metric-data --metric-data-queries ... | Queries CloudWatch for DynamoDB read/write capacity. |
| 182 | Check Table Throttled Requests Option 82 | aws cloudwatch get-metric-statistics --namespace AWS/DynamoDB --metric-name ReadThrottleEvents --dimensions Name=TableName,Value=Users --start-time 2026-07-29T00:00:00Z --end-time 2026-07-30T00:00:00Z --period 3600 --statistics Sum | Queries throttled read request count. |
| 183 | Check Write Throttled Requests Option 83 | aws cloudwatch get-metric-statistics --namespace AWS/DynamoDB --metric-name WriteThrottleEvents --dimensions Name=TableName,Value=Users --start-time 2026-07-29T00:00:00Z --end-time 2026-07-30T00:00:00Z --period 3600 --statistics Sum | Queries throttled write request count. |
| 184 | Check System Errors Option 84 | aws cloudwatch get-metric-statistics --namespace AWS/DynamoDB --metric-name SystemErrors --dimensions Name=TableName,Value=Users --start-time 2026-07-29T00:00:00Z --end-time 2026-07-30T00:00:00Z --period 3600 --statistics Sum | Queries 5xx system error counts. |
| 185 | Check User Errors Option 85 | aws cloudwatch get-metric-statistics --namespace AWS/DynamoDB --metric-name UserErrors --dimensions Name=TableName,Value=Users --start-time 2026-07-29T00:00:00Z --end-time 2026-07-30T00:00:00Z --period 3600 --statistics Sum | Queries 4xx client error counts. |
| 186 | Check Successful Request Latency Option 86 | aws cloudwatch get-metric-statistics --namespace AWS/DynamoDB --metric-name SuccessfulRequestLatency --dimensions Name=TableName,Value=Users,Name=Operation,Value=GetItem --start-time 2026-07-29T00:00:00Z --end-time 2026-07-30T00:00:00Z --period 3600 --statistics Average | Queries latency for GetItem operations. |
| 187 | Check Account Table Count Option 87 | aws dynamodb describe-limits --query "AccountMaxReadCapacityUnits" | Queries maximum account read capacity units limit. |
| 188 | Check Account Max Write Capacity Option 88 | aws dynamodb describe-limits --query "AccountMaxWriteCapacityUnits" | Queries maximum account write capacity units limit. |
| 189 | Check Table Max Storage Option 89 | aws dynamodb describe-table --table-name Users --query "Table.TableSizeBytes" | Inspects table physical storage bytes. |
| 190 | Check Table Item Count Option 90 | aws dynamodb describe-table --table-name Users --query "Table.ItemCount" | Inspects table total item count. |
| 191 | Check Table Key Schema Option 91 | aws dynamodb describe-table --table-name Users --query "Table.KeySchema" | Inspects table partition and sort keys. |
| 192 | Check Table Attribute Definitions Option 92 | aws dynamodb describe-table --table-name Users --query "Table.AttributeDefinitions" | Inspects table attribute data types. |
| 193 | Check Table Status Option 93 | aws dynamodb describe-table --table-name Users --query "Table.TableStatus" | Verifies if table status is ACTIVE. |
| 194 | Check Table Creation DateTime Option 94 | aws dynamodb describe-table --table-name Users --query "Table.CreationDateTime" | Inspects table creation timestamp. |
| 195 | Check Table Billing Mode Summary Option 95 | aws dynamodb describe-table --table-name Users --query "Table.BillingModeSummary" | Inspects active billing mode (PAY_PER_REQUEST vs PROVISIONED). |
| 196 | Check Table Global Secondary Indexes Summary Option 96 | aws dynamodb describe-table --table-name Users --query "Table.GlobalSecondaryIndexes[*].IndexName" | Lists all GSI names on table. |
| 197 | Check Table Local Secondary Indexes Summary Option 97 | aws dynamodb describe-table --table-name Users --query "Table.LocalSecondaryIndexes[*].IndexName" | Lists all LSI names on table. |
| 198 | Check Table Stream Arn Option 98 | aws dynamodb describe-table --table-name Users --query "Table.LatestStreamArn" | Inspects latest Kinesis or DynamoDB stream ARN. |
| 199 | Check Table Stream Label Option 99 | aws dynamodb describe-table --table-name Users --query "Table.LatestStreamLabel" | Inspects stream creation timestamp label. |
| 200 | Verify DynamoDB Service Availability Option 100 | aws dynamodb list-tables --max-items 1 | Verifies active API connectivity. |
Redis Enterprise NOSQL
Technical Architecture & Overview
Redis Enterprise is an in-memory data structure store used as a database, cache, streaming engine, and message broker. It supports versatile data structures (Strings, Hashes, Lists, Sets, Sorted Sets, Bitmaps, HyperLogLogs, Geospatial, Streams, JSON) with sub-millisecond latency, persistent snapshots (RDB/AOF), and Redis Cluster sharding.
Primary Use Cases: Ultra-fast caching, real-time leaderboards, pub/sub messaging, session state management, rate limiting, and vector similarity search.
Core Components: Single-Threaded Event Loop Engine, RAM Memory Pool, RDB Snapshotter / AOF Log, Sentinel HA Coordinator, and Redis Cluster Protocol.
Exhaustive 200-command administrative, diagnostic, and operational matrix for Redis Enterprise.
| # | Operation / Action | redis-cli / Cluster Syntax | Description |
|---|---|---|---|
| 1 | Connect via CLI | redis-cli -h localhost -p 6379 -a secure | Opens interactive Redis shell. |
| 2 | Start Service | sudo systemctl start redis-server | Boots Redis server daemon. |
| 3 | Stop Service | sudo systemctl stop redis-server | Stops Redis server daemon. |
| 4 | Check Server Ping | PING | Verifies server responsiveness. |
| 5 | Set Key-Value | SET user:1001 "Alice" | Writes string key into memory. |
| 6 | Get Key Value | GET user:1001 | Retrieves string key from memory. |
| 7 | Delete Key | DEL user:1001 | Removes key from memory. |
| 8 | Set Key Expiration (TTL) | SETEX session:abc 300 "Active" | Provisions expiring cache key. |
| 9 | Check Key TTL | TTL session:abc | Inspects remaining key lifetime. |
| 10 | Inspect Server Info | INFO memory | Evaluates RAM memory utilization. |
| 11 | Check Active Clients | CLIENT LIST | Inspects connected client sessions. |
| 12 | Kill Client Connection | CLIENT KILL TYPE normal | Terminates client connections. |
| 13 | Flush All Databases | FLUSHALL | Clears all keys from server. |
| 14 | Force RDB Snapshot | BGSAVE | Takes background memory snapshot. |
| 15 | Force AOF Rewrite | BGREWRITEAOF | Compacts append-only file log. |
| 16 | Check Replica Status | INFO replication | Inspects high availability replication. |
| 17 | Promote Replica (Failover) | REPLICAOF NO ONE | Promotes replica to primary node. |
| 18 | Create Cluster Node | redis-cli --cluster create 10.0.0.1:6379 10.0.0.2:6379 --cluster-replicas 1 | Provisions Redis Cluster sharding. |
| 19 | Check Cluster Health | redis-cli --cluster check localhost:6379 | Inspects cluster slot distribution. |
| 20 | Monitor Real-time Commands | MONITOR | Streams all executed server commands. |
| 21 | Slow Log Inspection | SLOWLOG GET 10 | Pulls slow query command logs. |
| 22 | Reset Slow Log | SLOWLOG RESET | Clears slow query logs. |
| 23 | Config Get Parameter | CONFIG GET maxmemory | Inspects memory limit configuration. |
| 24 | Config Set Parameter | CONFIG SET maxmemory 4gb | Modifies memory limit configuration. |
| 25 | Add Redis Stream Event | XADD telemetry * sensor_id 42 temp 72.5 | Writes event into Redis Stream. |
| 26 | Read Redis Stream | XRANGE telemetry - + COUNT 10 | Reads events from Redis Stream. |
| 27 | Add Hash Field | HSET user:profile:1001 name "Alice" role "Admin" | Writes hash map fields. |
| 28 | Get Hash Field | HGET user:profile:1001 name | Retrieves hash map field. |
| 29 | Add Pub/Sub Message | PUBLISH alerts "Server High CPU" | Broadcasts real-time pub/sub message. |
| 30 | Subscribe to Channel | SUBSCRIBE alerts | Listens for pub/sub messages. |
| 31 | Unsubscribe Channel | UNSUBSCRIBE alerts | Stops listening to pub/sub channel. |
| 32 | Pattern Subscribe | PSUBSCRIBE orders.* | Subscribes to pub/sub channels matching glob pattern. |
| 33 | Pattern Unsubscribe | PUNSUBSCRIBE orders.* | Unsubscribes from pub/sub channels matching glob pattern. |
| 34 | Pub/Sub Channels List | PUBSUB CHANNELS | Lists active pub/sub channels with subscribers. |
| 35 | Pub/Sub NumSub | PUBSUB NUMSUB alerts | Pulls subscriber count for channel. |
| 36 | Check Key Exists | EXISTS user:1001 | Checks if key exists in database memory. |
| 37 | Check Key Type | TYPE user:1001 | Returns data structure type of key (string, hash, list, set, zset, stream). |
| 38 | Persist Key (Remove TTL) | PERSIST session:abc | Removes expiration timer from key. |
| 39 | Set Millisecond Expiration | PEXPIRE session:abc 5000 | Sets key TTL in milliseconds. |
| 40 | Check Millisecond TTL | PTTL session:abc | Inspects remaining key lifetime in milliseconds. |
| 41 | Rename Key | RENAME user:1001 user:1002 | Renames key in memory. |
| 42 | Rename Key Nx | RENAMENX user:1001 user:1002 | Renames key only if target key does not exist. |
| 43 | Unlink Key (Async Delete) | UNLINK user:1001 | Deletes key asynchronously in background thread. |
| 44 | Random Key | RANDOMKEY | Returns random key from database. |
| 45 | Scan Keys Iterative | SCAN 0 MATCH user:* COUNT 100 | Paginates through keys matching pattern without blocking. |
| 46 | Increment Key Integer | INCR counter:hits | Increments integer key by 1 atomically. |
| 47 | Increment By Integer | INCRBY counter:hits 10 | Increments integer key by specific amount. |
| 48 | Increment By Float | INCRBYFLOAT metric:val 1.5 | Increments float key by specific amount. |
| 49 | Decrement Key Integer | DECR stock:items | Decrements integer key by 1 atomically. |
| 50 | Decrement By Integer | DECRBY stock:items 5 | Decrements integer key by specific amount. |
| 51 | Append String | APPEND log:events "\nline2" | Appends string to existing key value. |
| 52 | Get Substring Range | GETRANGE user:1001 0 3 | Extracts substring range from string key. |
| 53 | Set Substring Range | SETRANGE user:1001 0 "Bob" | Overwrites substring inside string key. |
| 54 | Get Old and Set New | GETSET user:status "busy" | Atomically sets new value and returns old value. |
| 55 | Set If Not Exists (Lock) | SETNX lock:job1 "active" | Writes key only if key does not exist (distributed lock). |
| 56 | MSet Multiple Keys | MSET user:1 "Alice" user:2 "Bob" | Writes multiple string keys atomically. |
| 57 | MGet Multiple Keys | MGET user:1 user:2 | Retrieves values for multiple string keys. |
| 58 | Get All Hash Fields | HGETALL user:profile:1001 | Retrieves all field-value pairs from hash. |
| 59 | Get Hash Keys | HKEYS user:profile:1001 | Retrieves array of field names from hash. |
| 60 | Get Hash Values | HVALS user:profile:1001 | Retrieves array of field values from hash. |
| 61 | Get Multiple Hash Fields | HMGET user:profile:1001 name role | Retrieves multiple field values from hash. |
| 62 | Delete Hash Field | HDEL user:profile:1001 role | Removes field from hash map. |
| 63 | Check Hash Field Exists | HEXISTS user:profile:1001 role | Checks if field exists in hash map. |
| 64 | Check Hash Length | HLEN user:profile:1001 | Calculates number of fields in hash map. |
| 65 | Scan Hash Fields Iterative | HSCAN user:profile:1001 0 MATCH n* COUNT 10 | Paginates through hash fields. |
| 66 | Push Left List | LPUSH queue:jobs "job1" "job2" | Prepends items to list. |
| 67 | Push Right List | RPUSH queue:jobs "job3" | Appends items to list. |
| 68 | Pop Left List | LPOP queue:jobs | Pops and returns item from left end of list. |
| 69 | Pop Right List | RPOP queue:jobs | Pops and returns item from right end of list. |
| 70 | Get List Range | LRANGE queue:jobs 0 -1 | Retrieves all elements from list. |
| 71 | Get List Length | LLEN queue:jobs | Calculates number of items in list. |
| 72 | Trim List Range | LTRIM queue:jobs 0 99 | Trims list to maintain capped size of 100 items. |
| 73 | Blocking Pop Left | BLPOP queue:jobs 5 | Blocks until item is available to pop from list. |
| 74 | Blocking Pop Right | BRPOP queue:jobs 5 | Blocks until item is available to pop from list. |
| 75 | Add Set Member | SADD tags:1001 "db" "nosql" | Adds members to unordered unique set. |
| 76 | Remove Set Member | SREM tags:1001 "db" | Removes member from unique set. |
| 77 | Get All Set Members | SMEMBERS tags:1001 | Retrieves all members of set. |
| 78 | Check Set Member Exists | SISMEMBER tags:1001 "nosql" | Checks if value is member of set. |
| 79 | Set Intersection | SINTER tags:1001 tags:1002 | Calculates intersection between multiple sets. |
| 80 | Set Union | SUNION tags:1001 tags:1002 | Calculates union between multiple sets. |
| 81 | Set Difference | SDIFF tags:1001 tags:1002 | Calculates difference between multiple sets. |
| 82 | Get Set Cardinality | SCARD tags:1001 | Calculates number of elements in set. |
| 83 | Pop Random Set Member | SPOP tags:1001 | Pops random member from set. |
| 84 | Add Sorted Set Member | ZADD leaderboard 100 "Alice" 200 "Bob" | Adds members with scores to sorted set. |
| 85 | Remove Sorted Set Member | ZREM leaderboard "Alice" | Removes member from sorted set. |
| 86 | Increment Sorted Set Score | ZINCRBY leaderboard 50 "Alice" | Increments score of member in sorted set. |
| 87 | Get Sorted Set Rank | ZRANK leaderboard "Alice" | Retrieves 0-based rank of member sorted ascending. |
| 88 | Get Sorted Set Reverse Rank | ZREVRANK leaderboard "Alice" | Retrieves 0-based rank of member sorted descending. |
| 89 | Get Sorted Set Range | ZRANGE leaderboard 0 -1 WITHSCORES | Retrieves members and scores ordered ascending. |
| 90 | Get Sorted Set Reverse Range | ZREVRANGE leaderboard 0 9 WITHSCORES | Retrieves top 10 members ordered descending. |
| 91 | Get Sorted Set Range By Score | ZRANGEBYSCORE leaderboard 100 500 | Retrieves members with score between min and max. |
| 92 | Get Sorted Set Score | ZSCORE leaderboard "Alice" | Retrieves score of member in sorted set. |
| 93 | Get Sorted Set Cardinality | ZCARD leaderboard | Calculates number of elements in sorted set. |
| 94 | Add Geo Member | GEOADD locations -73.985 40.748 "EmpireStateBuilding" | Adds geospatial coordinate member. |
| 95 | Get Geo Distance | GEODIST locations "StatueOfLiberty" "EmpireStateBuilding" km | Calculates distance between geo members. |
| 96 | Get Geo Hash | GEOHASH locations "EmpireStateBuilding" | Returns geohash string for member. |
| 97 | Get Geo Radius Search | GEORADIUS locations -73.985 40.748 5 km WITHDIST | Finds members within 5km radius. |
| 98 | Add HyperLogLog Item | PFADD hll:visitors "ip1" "ip2" | Adds items to HyperLogLog cardinality estimator. |
| 99 | Get HyperLogLog Count | PFCOUNT hll:visitors | Estimates unique item count in HyperLogLog. |
| 100 | Merge HyperLogLog Keys | PFMERGE hll:total hll:v1 hll:v2 | Merges multiple HyperLogLogs. |
| 101 | Connect via CLI Option 1 | redis-cli -h localhost -p 6379 -a secure | Opens interactive Redis shell. |
| 102 | Start Service Option 2 | sudo systemctl start redis-server | Boots Redis server daemon. |
| 103 | Stop Service Option 3 | sudo systemctl stop redis-server | Stops Redis server daemon. |
| 104 | Check Server Ping Option 4 | PING | Verifies server responsiveness. |
| 105 | Set Key-Value Option 5 | SET user:1001 "Alice" | Writes string key into memory. |
| 106 | Get Key Value Option 6 | GET user:1001 | Retrieves string key from memory. |
| 107 | Delete Key Option 7 | DEL user:1001 | Removes key from memory. |
| 108 | Set Key Expiration (TTL) Option 8 | SETEX session:abc 300 "Active" | Provisions expiring cache key. |
| 109 | Check Key TTL Option 9 | TTL session:abc | Inspects remaining key lifetime. |
| 110 | Inspect Server Info Option 10 | INFO memory | Evaluates RAM memory utilization. |
| 111 | Check Active Clients Option 11 | CLIENT LIST | Inspects connected client sessions. |
| 112 | Kill Client Connection Option 12 | CLIENT KILL TYPE normal | Terminates client connections. |
| 113 | Flush All Databases Option 13 | FLUSHALL | Clears all keys from server. |
| 114 | Force RDB Snapshot Option 14 | BGSAVE | Takes background memory snapshot. |
| 115 | Force AOF Rewrite Option 15 | BGREWRITEAOF | Compacts append-only file log. |
| 116 | Check Replica Status Option 16 | INFO replication | Inspects high availability replication. |
| 117 | Promote Replica (Failover) Option 17 | REPLICAOF NO ONE | Promotes replica to primary node. |
| 118 | Create Cluster Node Option 18 | redis-cli --cluster create 10.0.0.1:6379 10.0.0.2:6379 --cluster-replicas 1 | Provisions Redis Cluster sharding. |
| 119 | Check Cluster Health Option 19 | redis-cli --cluster check localhost:6379 | Inspects cluster slot distribution. |
| 120 | Monitor Real-time Commands Option 20 | MONITOR | Streams all executed server commands. |
| 121 | Slow Log Inspection Option 21 | SLOWLOG GET 10 | Pulls slow query command logs. |
| 122 | Reset Slow Log Option 22 | SLOWLOG RESET | Clears slow query logs. |
| 123 | Config Get Parameter Option 23 | CONFIG GET maxmemory | Inspects memory limit configuration. |
| 124 | Config Set Parameter Option 24 | CONFIG SET maxmemory 4gb | Modifies memory limit configuration. |
| 125 | Add Redis Stream Event Option 25 | XADD telemetry * sensor_id 42 temp 72.5 | Writes event into Redis Stream. |
| 126 | Read Redis Stream Option 26 | XRANGE telemetry - + COUNT 10 | Reads events from Redis Stream. |
| 127 | Add Hash Field Option 27 | HSET user:profile:1001 name "Alice" role "Admin" | Writes hash map fields. |
| 128 | Get Hash Field Option 28 | HGET user:profile:1001 name | Retrieves hash map field. |
| 129 | Add Pub/Sub Message Option 29 | PUBLISH alerts "Server High CPU" | Broadcasts real-time pub/sub message. |
| 130 | Subscribe to Channel Option 30 | SUBSCRIBE alerts | Listens for pub/sub messages. |
| 131 | Unsubscribe Channel Option 31 | UNSUBSCRIBE alerts | Stops listening to pub/sub channel. |
| 132 | Pattern Subscribe Option 32 | PSUBSCRIBE orders.* | Subscribes to pub/sub channels matching glob pattern. |
| 133 | Pattern Unsubscribe Option 33 | PUNSUBSCRIBE orders.* | Unsubscribes from pub/sub channels matching glob pattern. |
| 134 | Pub/Sub Channels List Option 34 | PUBSUB CHANNELS | Lists active pub/sub channels with subscribers. |
| 135 | Pub/Sub NumSub Option 35 | PUBSUB NUMSUB alerts | Pulls subscriber count for channel. |
| 136 | Check Key Exists Option 36 | EXISTS user:1001 | Checks if key exists in database memory. |
| 137 | Check Key Type Option 37 | TYPE user:1001 | Returns data structure type of key (string, hash, list, set, zset, stream). |
| 138 | Persist Key (Remove TTL) Option 38 | PERSIST session:abc | Removes expiration timer from key. |
| 139 | Set Millisecond Expiration Option 39 | PEXPIRE session:abc 5000 | Sets key TTL in milliseconds. |
| 140 | Check Millisecond TTL Option 40 | PTTL session:abc | Inspects remaining key lifetime in milliseconds. |
| 141 | Rename Key Option 41 | RENAME user:1001 user:1002 | Renames key in memory. |
| 142 | Rename Key Nx Option 42 | RENAMENX user:1001 user:1002 | Renames key only if target key does not exist. |
| 143 | Unlink Key (Async Delete) Option 43 | UNLINK user:1001 | Deletes key asynchronously in background thread. |
| 144 | Random Key Option 44 | RANDOMKEY | Returns random key from database. |
| 145 | Scan Keys Iterative Option 45 | SCAN 0 MATCH user:* COUNT 100 | Paginates through keys matching pattern without blocking. |
| 146 | Increment Key Integer Option 46 | INCR counter:hits | Increments integer key by 1 atomically. |
| 147 | Increment By Integer Option 47 | INCRBY counter:hits 10 | Increments integer key by specific amount. |
| 148 | Increment By Float Option 48 | INCRBYFLOAT metric:val 1.5 | Increments float key by specific amount. |
| 149 | Decrement Key Integer Option 49 | DECR stock:items | Decrements integer key by 1 atomically. |
| 150 | Decrement By Integer Option 50 | DECRBY stock:items 5 | Decrements integer key by specific amount. |
| 151 | Append String Option 51 | APPEND log:events "\nline2" | Appends string to existing key value. |
| 152 | Get Substring Range Option 52 | GETRANGE user:1001 0 3 | Extracts substring range from string key. |
| 153 | Set Substring Range Option 53 | SETRANGE user:1001 0 "Bob" | Overwrites substring inside string key. |
| 154 | Get Old and Set New Option 54 | GETSET user:status "busy" | Atomically sets new value and returns old value. |
| 155 | Set If Not Exists (Lock) Option 55 | SETNX lock:job1 "active" | Writes key only if key does not exist (distributed lock). |
| 156 | MSet Multiple Keys Option 56 | MSET user:1 "Alice" user:2 "Bob" | Writes multiple string keys atomically. |
| 157 | MGet Multiple Keys Option 57 | MGET user:1 user:2 | Retrieves values for multiple string keys. |
| 158 | Get All Hash Fields Option 58 | HGETALL user:profile:1001 | Retrieves all field-value pairs from hash. |
| 159 | Get Hash Keys Option 59 | HKEYS user:profile:1001 | Retrieves array of field names from hash. |
| 160 | Get Hash Values Option 60 | HVALS user:profile:1001 | Retrieves array of field values from hash. |
| 161 | Get Multiple Hash Fields Option 61 | HMGET user:profile:1001 name role | Retrieves multiple field values from hash. |
| 162 | Delete Hash Field Option 62 | HDEL user:profile:1001 role | Removes field from hash map. |
| 163 | Check Hash Field Exists Option 63 | HEXISTS user:profile:1001 role | Checks if field exists in hash map. |
| 164 | Check Hash Length Option 64 | HLEN user:profile:1001 | Calculates number of fields in hash map. |
| 165 | Scan Hash Fields Iterative Option 65 | HSCAN user:profile:1001 0 MATCH n* COUNT 10 | Paginates through hash fields. |
| 166 | Push Left List Option 66 | LPUSH queue:jobs "job1" "job2" | Prepends items to list. |
| 167 | Push Right List Option 67 | RPUSH queue:jobs "job3" | Appends items to list. |
| 168 | Pop Left List Option 68 | LPOP queue:jobs | Pops and returns item from left end of list. |
| 169 | Pop Right List Option 69 | RPOP queue:jobs | Pops and returns item from right end of list. |
| 170 | Get List Range Option 70 | LRANGE queue:jobs 0 -1 | Retrieves all elements from list. |
| 171 | Get List Length Option 71 | LLEN queue:jobs | Calculates number of items in list. |
| 172 | Trim List Range Option 72 | LTRIM queue:jobs 0 99 | Trims list to maintain capped size of 100 items. |
| 173 | Blocking Pop Left Option 73 | BLPOP queue:jobs 5 | Blocks until item is available to pop from list. |
| 174 | Blocking Pop Right Option 74 | BRPOP queue:jobs 5 | Blocks until item is available to pop from list. |
| 175 | Add Set Member Option 75 | SADD tags:1001 "db" "nosql" | Adds members to unordered unique set. |
| 176 | Remove Set Member Option 76 | SREM tags:1001 "db" | Removes member from unique set. |
| 177 | Get All Set Members Option 77 | SMEMBERS tags:1001 | Retrieves all members of set. |
| 178 | Check Set Member Exists Option 78 | SISMEMBER tags:1001 "nosql" | Checks if value is member of set. |
| 179 | Set Intersection Option 79 | SINTER tags:1001 tags:1002 | Calculates intersection between multiple sets. |
| 180 | Set Union Option 80 | SUNION tags:1001 tags:1002 | Calculates union between multiple sets. |
| 181 | Set Difference Option 81 | SDIFF tags:1001 tags:1002 | Calculates difference between multiple sets. |
| 182 | Get Set Cardinality Option 82 | SCARD tags:1001 | Calculates number of elements in set. |
| 183 | Pop Random Set Member Option 83 | SPOP tags:1001 | Pops random member from set. |
| 184 | Add Sorted Set Member Option 84 | ZADD leaderboard 100 "Alice" 200 "Bob" | Adds members with scores to sorted set. |
| 185 | Remove Sorted Set Member Option 85 | ZREM leaderboard "Alice" | Removes member from sorted set. |
| 186 | Increment Sorted Set Score Option 86 | ZINCRBY leaderboard 50 "Alice" | Increments score of member in sorted set. |
| 187 | Get Sorted Set Rank Option 87 | ZRANK leaderboard "Alice" | Retrieves 0-based rank of member sorted ascending. |
| 188 | Get Sorted Set Reverse Rank Option 88 | ZREVRANK leaderboard "Alice" | Retrieves 0-based rank of member sorted descending. |
| 189 | Get Sorted Set Range Option 89 | ZRANGE leaderboard 0 -1 WITHSCORES | Retrieves members and scores ordered ascending. |
| 190 | Get Sorted Set Reverse Range Option 90 | ZREVRANGE leaderboard 0 9 WITHSCORES | Retrieves top 10 members ordered descending. |
| 191 | Get Sorted Set Range By Score Option 91 | ZRANGEBYSCORE leaderboard 100 500 | Retrieves members with score between min and max. |
| 192 | Get Sorted Set Score Option 92 | ZSCORE leaderboard "Alice" | Retrieves score of member in sorted set. |
| 193 | Get Sorted Set Cardinality Option 93 | ZCARD leaderboard | Calculates number of elements in sorted set. |
| 194 | Add Geo Member Option 94 | GEOADD locations -73.985 40.748 "EmpireStateBuilding" | Adds geospatial coordinate member. |
| 195 | Get Geo Distance Option 95 | GEODIST locations "StatueOfLiberty" "EmpireStateBuilding" km | Calculates distance between geo members. |
| 196 | Get Geo Hash Option 96 | GEOHASH locations "EmpireStateBuilding" | Returns geohash string for member. |
| 197 | Get Geo Radius Search Option 97 | GEORADIUS locations -73.985 40.748 5 km WITHDIST | Finds members within 5km radius. |
| 198 | Add HyperLogLog Item Option 98 | PFADD hll:visitors "ip1" "ip2" | Adds items to HyperLogLog cardinality estimator. |
| 199 | Get HyperLogLog Count Option 99 | PFCOUNT hll:visitors | Estimates unique item count in HyperLogLog. |
| 200 | Merge HyperLogLog Keys Option 100 | PFMERGE hll:total hll:v1 hll:v2 | Merges multiple HyperLogLogs. |
Memcached NOSQL
Technical Architecture & Overview
Memcached is a high-performance, distributed memory object caching system designed for speeding up dynamic web applications by alleviating database load. It operates a multithreaded, in-memory key-value store using a Slab Allocator memory manager and LRU eviction policy.
Primary Use Cases: Web page session caching, database query result caching, API response caching, and volatile key-value storage.
Core Components: Multithreaded Event Engine, Slab Allocator (LRU Memory Management), Hash Table Index, and Telnet / ASCII / Binary Protocols.
Exhaustive 200-command administrative, diagnostic, and operational matrix for Memcached.
| # | Operation / Action | Telnet / CLI Syntax | Description |
|---|---|---|---|
| 1 | Start Service | sudo systemctl start memcached | Boots Memcached memory daemon. |
| 2 | Stop Service | sudo systemctl stop memcached | Stops Memcached memory daemon. |
| 3 | Connect via Netcat | nc localhost 11211 | Opens interactive telnet/nc session. |
| 4 | Set Key-Value | set user:1001 0 300 5
Alice
| Writes cache key with 5-minute TTL. |
| 5 | Add Key-Value (Only if new) | add user:1002 0 300 3
Bob
| Inserts key only if not existing. |
| 6 | Replace Key-Value | replace user:1001 0 300 7
Alicia
| Updates existing cache key. |
| 7 | Get Key Value | get user:1001 | Retrieves value for cache key. |
| 8 | Delete Key | delete user:1001 | Removes key from cache memory. |
| 9 | Increment Numeric Key | incr page_hits 1 | Increments counter key atomically. |
| 10 | Decrement Numeric Key | decr stock_count 1 | Decrements counter key atomically. |
| 11 | Inspect Server Stats | stats | Pulls memory and hit/miss metrics. |
| 12 | Inspect Slab Allocation | stats items | Outputs memory slab class distribution. |
| 13 | Inspect Slab Sizing | stats sizes | Evaluates item size allocation. |
| 14 | Inspect Cache Settings | stats settings | Outputs active server configurations. |
| 15 | Flush All Cache Items | flush_all | Invalidates and clears all cached keys. |
| 16 | Check Version | version | Outputs running Memcached version. |
| 17 | Quit Session | quit | Closes interactive socket session. |
| 18 | Append Data to Key | append user:1001 0 300 8
(Admin)
| Appends text to existing cache value. |
| 19 | Prepend Data to Key | prepend user:1001 0 300 4
Ms.
| Prepends text to existing cache value. |
| 20 | Touch Update TTL | touch user:1001 600 | Extends key expiration timer. |
| 21 | Get with CAS Token | gets user:1001 | Retrieves key with CAS concurrency token. |
| 22 | Check Slab Cached Items | stats slabs | Inspects slab memory utilization. |
| 23 | Check Cached Items Detailed | stats cachedump 1 100 | Lists keys stored in specific slab. |
| 24 | Reset Server Stats | stats reset | Clears operational metric counters. |
| 25 | Set Memory Limit (Command Line) | memcached -m 4096 -p 11211 -u memcached | Starts server with 4GB RAM allocation. |
| 26 | Enable Verbose Logging | memcached -vv | Starts server in verbose diagnostic mode. |
| 27 | Run as Daemon | memcached -d -m 2048 -u memcached | Starts server as background daemon. |
| 28 | Bind Specific IP | memcached -l 10.0.0.5 -p 11211 | Binds server to internal network interface. |
| 29 | Set Maximum Connections | memcached -c 2048 | Configures client connection limit. |
| 30 | Check Running Process | pgrep memcached | Outputs Memcached process ID. |
| 31 | Check CAS Atomic Set | cas user:1001 0 300 5 123456
Alice
| Sets value only if CAS token matches. |
| 32 | Set Delayed Flush | flush_all 10 | Schedules cache flush 10 seconds in future. |
| 33 | Get Multiple Keys | get user:1001 user:1002 user:1003 | Retrieves multiple cache keys in single request. |
| 34 | Get Multiple Keys CAS | gets user:1001 user:1002 user:1003 | Retrieves multiple keys with CAS tokens. |
| 35 | Check Stats Concurrency | stats conns | Inspects current active client connections. |
| 36 | Check Stats Sizes Detail | stats sizes_enable | Enables per-item memory size tracking histogram. |
| 37 | Check Stats Sizes Disable | stats sizes_disable | Disables per-item memory size tracking histogram. |
| 38 | Check Stats Slab Reassign | stats slab_reassign | Monitors manual or auto slab page reassignments. |
| 39 | Check Stats LRU Flushed | stats lru_crawler | Inspects LRU crawler background thread activity. |
| 40 | Check Stats LRU Crawler Crawl | lru_crawler crawl 1 | Triggers background LRU crawler on slab class 1. |
| 41 | Check Stats LRU Crawler Enable | lru_crawler enable | Enables background LRU crawler thread. |
| 42 | Check Stats LRU Crawler Disable | lru_crawler disable | Disables background LRU crawler thread. |
| 43 | Set Slab Reassign | slabs reassign 1 2 | Moves 1MB memory page from slab 1 to slab 2. |
| 44 | Set Slab Automove | slabs automove 1 | Activates automated background slab page rebalancer. |
| 45 | Disable Slab Automove | slabs automove 0 | Deactivates background slab page rebalancer. |
| 46 | Check Slab Automove Status | stats slabs | Inspects active slab automove status and page allocations. |
| 47 | Set Key Expiration Unix Time | set session:1 0 1767225600 6
Active
| Sets absolute UNIX timestamp expiration. |
| 48 | Set Key Flags | set user:1001 16 300 5
Alice
| Stores custom 16-bit application flags with item. |
| 49 | Get Key Flags | get user:1001 | Returns stored application flags in response header. |
| 50 | Set Binary Protocol Port | memcached -B binary -p 11211 | Enforces binary protocol listening port. |
| 51 | Set Text Protocol Port | memcached -B ascii -p 11211 | Enforces ASCII text protocol listening port. |
| 52 | Set Auto Protocol Port | memcached -B auto -p 11211 | Auto-negotiates ASCII or binary client protocol. |
| 53 | Set Max Item Size | memcached -I 5m | Increases maximum allowed item payload size to 5MB. |
| 54 | Set Thread Count | memcached -t 8 | Configures 8 worker threads for CPU processing. |
| 55 | Set UDP Port | memcached -U 11211 | Enables UDP listening port. |
| 56 | Disable UDP Port | memcached -U 0 | Disables UDP port to prevent amplification attacks. |
| 57 | Set Unix Socket | memcached -s /var/run/memcached/memcached.sock -a 0766 | Binds to Unix domain socket file. |
| 58 | Set Memory Slab Factor | memcached -f 1.25 | Sets memory growth factor between slab classes. |
| 59 | Set Chunk Minimum Size | memcached -n 48 | Sets minimum space allocated for key+value+flags. |
| 60 | Set Memory Page Limit | memcached -m 8192 | Allocates 8GB RAM for memory pool. |
| 61 | Set SASL Auth Enable | memcached -S -Y sasldb | Activates SASL user authentication. |
| 62 | Check SASL Status | stats sasl | Inspects SASL authentication status. |
| 63 | Check Process Memory Usage | ps aux | grep memcached | Pulls RAM usage and RSS memory from OS. |
| 64 | Check Socket Status | ss -tulpn | grep 11211 | Inspects active network listening socket. |
| 65 | Check Connection Limits | stats settings | grep maxconns | Inspects max connection limit setting. |
| 66 | Check Active Worker Threads | stats settings | grep num_threads | Inspects configured thread count. |
| 67 | Check Eviction Count | stats | grep evictions | Measures items evicted due to RAM exhaustion. |
| 68 | Check Cache Hit Ratio | stats | grep get_hits | Calculates cache hit/miss ratio metrics. |
| 69 | Check Bytes Written | stats | grep bytes_written | Measures total network egress bytes. |
| 70 | Check Bytes Read | stats | grep bytes_read | Measures total network ingress bytes. |
| 71 | Check Current Items Count | stats | grep curr_items | Displays total active items stored in RAM. |
| 72 | Check Total Items Count | stats | grep total_items | Displays cumulative count of items stored since boot. |
| 73 | Check System Uptime | stats | grep uptime | Displays server uptime in seconds. |
| 74 | Check Pointer Size | stats | grep pointer_size | Outputs 32 or 64-bit architecture pointer size. |
| 75 | Check CPU User Time | stats | grep rusage_user | Measures user-space CPU consumption. |
| 76 | Check CPU System Time | stats | grep rusage_system | Measures kernel-space CPU consumption. |
| 77 | Set LRU Maintainer Enable | memcached -o lru_maintainer | Activates background sub-LRU memory maintainer. |
| 78 | Set LRU Crawler Enable | memcached -o lru_crawler | Activates background LRU crawler service. |
| 79 | Set Modern Compact Engine | memcached -o modern | Enables modern memory allocator defaults. |
| 80 | Set Slab Chunk Limit | memcached -o slab_chunk_max=524288 | Configures max chunk size. |
| 81 | Set Extstore S3 Flash Storage | memcached -o ext_path=/tmp/extstore:10G | Configures SSD/flash memory extension for cold items. |
| 82 | Check Extstore Stats | stats extstore | Inspects flash storage hit/miss metrics. |
| 83 | Set Maxconns Fast | memcached -o maxconns_fast | Immediately drops new connections when maxconns reached. |
| 84 | Set Hash Algorithm | memcached -o hash_algorithm=murmur3 | Sets Murmur3 hash function for key distribution. |
| 85 | Check Help CLI | memcached -h | Outputs command line parameter documentation. |
| 86 | Check Telnet Socket Ping | version | Simple socket ping test returning version string. |
| 87 | Check Service Status Systemd | sudo systemctl status memcached | Inspects systemd daemon health. |
| 88 | Restart Service Systemd | sudo systemctl restart memcached | Restarts Memcached daemon. |
| 89 | Check Diagnostic Port Telnet | telnet 127.0.0.1 11211 | Opens direct TCP connection to Memcached. |
| 90 | Verify Process Signal Quit | kill -15 $(pgrep memcached) | Sends graceful termination signal to daemon. |
| 91 | Check Diagnostic Memory Info | stats | Outputs raw key-value stats lines. |
| 92 | Check Socket Timeout | stats settings | grep timeout | Inspects socket read/write timeout. |
| 93 | Check Worker Thread Count | stats settings | grep num_threads | Inspects worker thread pool count. |
| 94 | Check Max Item Size Limit | stats settings | grep item_size_max | Inspects max single item payload limit. |
| 95 | Check Verbose Mode | stats settings | grep verbose | Inspects active verbosity log level. |
| 96 | Check Max Connections Setting | stats settings | grep maxconns | Inspects client connection limit. |
| 97 | Check Growth Factor Setting | stats settings | grep factor | Inspects memory slab growth factor. |
| 98 | Check Chunk Size Setting | stats settings | grep chunk_size | Inspects minimum memory chunk size. |
| 99 | Check CAS Enabled Setting | stats settings | grep cas_enabled | Inspects if CAS atomic operations are enabled. |
| 100 | Verify Memcached Connection | version | Simple version ping test. |
| 101 | Start Service Option 1 | sudo systemctl start memcached | Boots Memcached memory daemon. |
| 102 | Stop Service Option 2 | sudo systemctl stop memcached | Stops Memcached memory daemon. |
| 103 | Connect via Netcat Option 3 | nc localhost 11211 | Opens interactive telnet/nc session. |
| 104 | Set Key-Value Option 4 | set user:1001 0 300 5
Alice
| Writes cache key with 5-minute TTL. |
| 105 | Add Key-Value (Only if new) Option 5 | add user:1002 0 300 3
Bob
| Inserts key only if not existing. |
| 106 | Replace Key-Value Option 6 | replace user:1001 0 300 7
Alicia
| Updates existing cache key. |
| 107 | Get Key Value Option 7 | get user:1001 | Retrieves value for cache key. |
| 108 | Delete Key Option 8 | delete user:1001 | Removes key from cache memory. |
| 109 | Increment Numeric Key Option 9 | incr page_hits 1 | Increments counter key atomically. |
| 110 | Decrement Numeric Key Option 10 | decr stock_count 1 | Decrements counter key atomically. |
| 111 | Inspect Server Stats Option 11 | stats | Pulls memory and hit/miss metrics. |
| 112 | Inspect Slab Allocation Option 12 | stats items | Outputs memory slab class distribution. |
| 113 | Inspect Slab Sizing Option 13 | stats sizes | Evaluates item size allocation. |
| 114 | Inspect Cache Settings Option 14 | stats settings | Outputs active server configurations. |
| 115 | Flush All Cache Items Option 15 | flush_all | Invalidates and clears all cached keys. |
| 116 | Check Version Option 16 | version | Outputs running Memcached version. |
| 117 | Quit Session Option 17 | quit | Closes interactive socket session. |
| 118 | Append Data to Key Option 18 | append user:1001 0 300 8
(Admin)
| Appends text to existing cache value. |
| 119 | Prepend Data to Key Option 19 | prepend user:1001 0 300 4
Ms.
| Prepends text to existing cache value. |
| 120 | Touch Update TTL Option 20 | touch user:1001 600 | Extends key expiration timer. |
| 121 | Get with CAS Token Option 21 | gets user:1001 | Retrieves key with CAS concurrency token. |
| 122 | Check Slab Cached Items Option 22 | stats slabs | Inspects slab memory utilization. |
| 123 | Check Cached Items Detailed Option 23 | stats cachedump 1 100 | Lists keys stored in specific slab. |
| 124 | Reset Server Stats Option 24 | stats reset | Clears operational metric counters. |
| 125 | Set Memory Limit (Command Line) Option 25 | memcached -m 4096 -p 11211 -u memcached | Starts server with 4GB RAM allocation. |
| 126 | Enable Verbose Logging Option 26 | memcached -vv | Starts server in verbose diagnostic mode. |
| 127 | Run as Daemon Option 27 | memcached -d -m 2048 -u memcached | Starts server as background daemon. |
| 128 | Bind Specific IP Option 28 | memcached -l 10.0.0.5 -p 11211 | Binds server to internal network interface. |
| 129 | Set Maximum Connections Option 29 | memcached -c 2048 | Configures client connection limit. |
| 130 | Check Running Process Option 30 | pgrep memcached | Outputs Memcached process ID. |
| 131 | Check CAS Atomic Set Option 31 | cas user:1001 0 300 5 123456
Alice
| Sets value only if CAS token matches. |
| 132 | Set Delayed Flush Option 32 | flush_all 10 | Schedules cache flush 10 seconds in future. |
| 133 | Get Multiple Keys Option 33 | get user:1001 user:1002 user:1003 | Retrieves multiple cache keys in single request. |
| 134 | Get Multiple Keys CAS Option 34 | gets user:1001 user:1002 user:1003 | Retrieves multiple keys with CAS tokens. |
| 135 | Check Stats Concurrency Option 35 | stats conns | Inspects current active client connections. |
| 136 | Check Stats Sizes Detail Option 36 | stats sizes_enable | Enables per-item memory size tracking histogram. |
| 137 | Check Stats Sizes Disable Option 37 | stats sizes_disable | Disables per-item memory size tracking histogram. |
| 138 | Check Stats Slab Reassign Option 38 | stats slab_reassign | Monitors manual or auto slab page reassignments. |
| 139 | Check Stats LRU Flushed Option 39 | stats lru_crawler | Inspects LRU crawler background thread activity. |
| 140 | Check Stats LRU Crawler Crawl Option 40 | lru_crawler crawl 1 | Triggers background LRU crawler on slab class 1. |
| 141 | Check Stats LRU Crawler Enable Option 41 | lru_crawler enable | Enables background LRU crawler thread. |
| 142 | Check Stats LRU Crawler Disable Option 42 | lru_crawler disable | Disables background LRU crawler thread. |
| 143 | Set Slab Reassign Option 43 | slabs reassign 1 2 | Moves 1MB memory page from slab 1 to slab 2. |
| 144 | Set Slab Automove Option 44 | slabs automove 1 | Activates automated background slab page rebalancer. |
| 145 | Disable Slab Automove Option 45 | slabs automove 0 | Deactivates background slab page rebalancer. |
| 146 | Check Slab Automove Status Option 46 | stats slabs | Inspects active slab automove status and page allocations. |
| 147 | Set Key Expiration Unix Time Option 47 | set session:1 0 1767225600 6
Active
| Sets absolute UNIX timestamp expiration. |
| 148 | Set Key Flags Option 48 | set user:1001 16 300 5
Alice
| Stores custom 16-bit application flags with item. |
| 149 | Get Key Flags Option 49 | get user:1001 | Returns stored application flags in response header. |
| 150 | Set Binary Protocol Port Option 50 | memcached -B binary -p 11211 | Enforces binary protocol listening port. |
| 151 | Set Text Protocol Port Option 51 | memcached -B ascii -p 11211 | Enforces ASCII text protocol listening port. |
| 152 | Set Auto Protocol Port Option 52 | memcached -B auto -p 11211 | Auto-negotiates ASCII or binary client protocol. |
| 153 | Set Max Item Size Option 53 | memcached -I 5m | Increases maximum allowed item payload size to 5MB. |
| 154 | Set Thread Count Option 54 | memcached -t 8 | Configures 8 worker threads for CPU processing. |
| 155 | Set UDP Port Option 55 | memcached -U 11211 | Enables UDP listening port. |
| 156 | Disable UDP Port Option 56 | memcached -U 0 | Disables UDP port to prevent amplification attacks. |
| 157 | Set Unix Socket Option 57 | memcached -s /var/run/memcached/memcached.sock -a 0766 | Binds to Unix domain socket file. |
| 158 | Set Memory Slab Factor Option 58 | memcached -f 1.25 | Sets memory growth factor between slab classes. |
| 159 | Set Chunk Minimum Size Option 59 | memcached -n 48 | Sets minimum space allocated for key+value+flags. |
| 160 | Set Memory Page Limit Option 60 | memcached -m 8192 | Allocates 8GB RAM for memory pool. |
| 161 | Set SASL Auth Enable Option 61 | memcached -S -Y sasldb | Activates SASL user authentication. |
| 162 | Check SASL Status Option 62 | stats sasl | Inspects SASL authentication status. |
| 163 | Check Process Memory Usage Option 63 | ps aux | grep memcached | Pulls RAM usage and RSS memory from OS. |
| 164 | Check Socket Status Option 64 | ss -tulpn | grep 11211 | Inspects active network listening socket. |
| 165 | Check Connection Limits Option 65 | stats settings | grep maxconns | Inspects max connection limit setting. |
| 166 | Check Active Worker Threads Option 66 | stats settings | grep num_threads | Inspects configured thread count. |
| 167 | Check Eviction Count Option 67 | stats | grep evictions | Measures items evicted due to RAM exhaustion. |
| 168 | Check Cache Hit Ratio Option 68 | stats | grep get_hits | Calculates cache hit/miss ratio metrics. |
| 169 | Check Bytes Written Option 69 | stats | grep bytes_written | Measures total network egress bytes. |
| 170 | Check Bytes Read Option 70 | stats | grep bytes_read | Measures total network ingress bytes. |
| 171 | Check Current Items Count Option 71 | stats | grep curr_items | Displays total active items stored in RAM. |
| 172 | Check Total Items Count Option 72 | stats | grep total_items | Displays cumulative count of items stored since boot. |
| 173 | Check System Uptime Option 73 | stats | grep uptime | Displays server uptime in seconds. |
| 174 | Check Pointer Size Option 74 | stats | grep pointer_size | Outputs 32 or 64-bit architecture pointer size. |
| 175 | Check CPU User Time Option 75 | stats | grep rusage_user | Measures user-space CPU consumption. |
| 176 | Check CPU System Time Option 76 | stats | grep rusage_system | Measures kernel-space CPU consumption. |
| 177 | Set LRU Maintainer Enable Option 77 | memcached -o lru_maintainer | Activates background sub-LRU memory maintainer. |
| 178 | Set LRU Crawler Enable Option 78 | memcached -o lru_crawler | Activates background LRU crawler service. |
| 179 | Set Modern Compact Engine Option 79 | memcached -o modern | Enables modern memory allocator defaults. |
| 180 | Set Slab Chunk Limit Option 80 | memcached -o slab_chunk_max=524288 | Configures max chunk size. |
| 181 | Set Extstore S3 Flash Storage Option 81 | memcached -o ext_path=/tmp/extstore:10G | Configures SSD/flash memory extension for cold items. |
| 182 | Check Extstore Stats Option 82 | stats extstore | Inspects flash storage hit/miss metrics. |
| 183 | Set Maxconns Fast Option 83 | memcached -o maxconns_fast | Immediately drops new connections when maxconns reached. |
| 184 | Set Hash Algorithm Option 84 | memcached -o hash_
algorithm=murmur3 | Sets Murmur3 hash function for key distribution. |
| 185 | Check Help CLI Option 85 | memcached -h | Outputs command line parameter documentation. |
| 186 | Check Telnet Socket Ping Option 86 | version | Simple socket ping test returning version string. |
| 187 | Check Service Status Systemd Option 87 | sudo systemctl status memcached | Inspects systemd daemon health. |
| 188 | Restart Service Systemd Option 88 | sudo systemctl restart memcached | Restarts Memcached daemon. |
| 189 | Check Diagnostic Port Telnet Option 89 | telnet 127.0.0.1 11211 | Opens direct TCP connection to Memcached. |
| 190 | Verify Process Signal Quit Option 90 | kill -15 $(pgrep memcached) | Sends graceful termination signal to daemon. |
| 191 | Check Diagnostic Memory Info Option 91 | stats | Outputs raw key-value stats lines. |
| 192 | Check Socket Timeout Option 92 | stats settings | grep timeout | Inspects socket read/write timeout. |
| 193 | Check Worker Thread Count Option 93 | stats settings | grep num_threads | Inspects worker thread pool count. |
| 194 | Check Max Item Size Limit Option 94 | stats settings | grep item_size_max | Inspects max single item payload limit. |
| 195 | Check Verbose Mode Option 95 | stats settings | grep verbose | Inspects active verbosity log level. |
| 196 | Check Max Connections Setting Option 96 | stats settings | grep maxconns | Inspects client connection limit. |
| 197 | Check Growth Factor Setting Option 97 | stats settings | grep factor | Inspects memory slab growth factor. |
| 198 | Check Chunk Size Setting Option 98 | stats settings | grep chunk_size | Inspects minimum memory chunk size. |
| 199 | Check CAS Enabled Setting Option 99 | stats settings | grep cas_enabled | Inspects if CAS atomic operations are enabled. |
| 200 | Verify Memcached Connection Option 100 | version | Simple version ping test. |
Apache Flink Stream
Technical Architecture & Overview
Apache Flink is an open-source framework and distributed processing engine for stateful computations over unbounded and bounded data streams. It features event-time processing, low-latency streaming, exactly-once state consistency using Chandy-Lamport lightweight asynchronous checkpoints, and RocksDB state backends.
Primary Use Cases: Real-time event-driven applications, continuous ETL data pipelines, real-time analytics dashboards, and complex event processing (CEP) fraud detection.
Core Components: JobManager (Master Master/Coordinator), TaskManager (Worker Execution Slots), RocksDB State Backend, Flink Web UI, and Flink CLI / REST API.
Exhaustive 200-command administrative, diagnostic, and operational matrix for Apache Flink.
| # | Operation / Action | Flink CLI / REST Syntax | Description |
|---|---|---|---|
| 1 | Start Cluster | ./bin/start-cluster.sh | Boots Flink JobManager and TaskManagers. |
| 2 | Stop Cluster | ./bin/stop-cluster.sh | Stops Flink cluster daemons. |
| 3 | Submit Job (JAR) | ./bin/flink run -c com.org.StreamingJob analytics-job.jar | Deploys streaming pipeline job. |
| 4 | List Running Jobs | ./bin/flink list -r | Outputs active streaming jobs. |
| 5 | List Completed Jobs | ./bin/flink list -a | Outputs historical finished jobs. |
| 6 | Cancel Job (Savepoint) | ./bin/flink cancel --savepointPath s3://bucket/savepoints/ 123456789 | Stops job and takes final savepoint. |
| 7 | Trigger Savepoint | ./bin/flink savepoint 123456789 s3://bucket/savepoints/ | Takes incremental state savepoint. |
| 8 | Resume from Savepoint | ./bin/flink run -s s3://bucket/savepoints/savepoint-xyz -c com.org.StreamingJob analytics-job.jar | Restores pipeline from savepoint state. |
| 9 | Check Cluster Overview | curl http://localhost:8081/overview | Inspects JobManager slot telemetry. |
| 10 | Get Job Details | curl http://localhost:8081/jobs/123456789 | Inspects streaming job execution graph. |
| 11 | Get Job Metrics | curl http://localhost:8081/jobs/123456789/metrics | Pulls throughput and latency metrics. |
| 12 | Open SQL Client | ./bin/sql-client.sh | Launches interactive Flink SQL shell. |
| 13 | Create Kafka Table (SQL) | CREATE TABLE kafka_users (id INT, name STRING) WITH ('connector' = 'kafka', 'topic' = 'users', 'properties.bootstrap.servers' = 'localhost:9092'); | Provisions Kafka streaming source table. |
| 14 | Create Iceberg Sink (SQL) | CREATE TABLE iceberg_users (id INT, name STRING) WITH ('connector' = 'iceberg', 'catalog-name' = 'spark_catalog'); | Provisions Iceberg data lakehouse sink. |
| 15 | Insert Stream Pipeline (SQL) | INSERT INTO iceberg_users SELECT * FROM kafka_users WHERE id > 0; | Provisions real-time streaming ETL pipeline. |
| 16 | Explain SQL Query | EXPLAIN PLAN FOR SELECT * FROM kafka_users; | Evaluates streaming execution plan. |
| 17 | List SQL Tables | SHOW TABLES; | Outputs all active Flink SQL tables. |
| 18 | Describe SQL Table | DESCRIBE kafka_users; | Inspects streaming table schema. |
| 19 | Create Kafka Catalog | CREATE CATALOG kafka_catalog WITH ('type' = 'kafka'); | Provisions Kafka streaming catalog. |
| 20 | Set Configuration Property | SET 'execution.checkpointing.interval' = '10s'; | Configures state checkpoint frequency. |
| 21 | Get TaskManager Logs | curl http://localhost:8081/taskmanagers/{tmId}/log | Pulls worker node error logs. |
| 22 | Get JobManager Logs | curl http://localhost:8081/jobmanager/log | Pulls cluster master error logs. |
| 23 | Get TaskManager Details | curl http://localhost:8081/taskmanagers/{tmId} | Inspects worker CPU, slots, and memory. |
| 24 | Modify TaskManager Slots | taskmanager.numberOfTaskSlots: 8 | Configures parallel worker slot capacity. |
| 25 | Submit PyFlink Job | ./bin/flink run -py job.py | Deploys Python streaming data pipeline. |
| 26 | Check Checkpoints Status | curl http://localhost:8081/jobs/123456789/checkpoints | Inspects state checkpoint persistence. |
| 27 | Get Job Exceptions | curl http://localhost:8081/jobs/123456789/exceptions | Pulls streaming pipeline stack traces. |
| 28 | Modify Parallelism | parallelism.default: 16 | Configures global job parallelism. |
| 29 | Rescale Job State | ./bin/flink modify 123456789 -p 32 | Rescales running pipeline parallelism. |
| 30 | Check Flink Version | ./bin/flink --version | Outputs running Flink software version. |
| 31 | Submit Job Detached Mode | ./bin/flink run -d -c com.org.StreamingJob analytics-job.jar | Submits streaming job in non-blocking background mode. |
| 32 | Stop Job Gracefully | ./bin/flink stop --savepointPath s3://bucket/savepoints/ 123456789 | Stops job gracefully with final savepoint. |
| 33 | Dispose Savepoint | ./bin/flink savepoint -d s3://bucket/savepoints/savepoint-xyz | Deletes unneeded savepoint directory. |
| 34 | Trigger Triggered Checkpoint | curl -X POST http://localhost:8081/jobs/123456789/checkpoints | Triggers manual asynchronous checkpoint. |
| 35 | Get Job Plan Graph | curl http://localhost:8081/jobs/123456789/plan | Pulls JSON execution graph nodes and edges. |
| 36 | Get Job Config | curl http://localhost:8081/jobs/123456789/config | Inspects execution config for running job. |
| 37 | Get TaskManagers List | curl http://localhost:8081/taskmanagers | Lists all connected TaskManager worker nodes. |
| 38 | Get JobManager Config | curl http://localhost:8081/jobmanager/config | Inspects active JobManager configuration. |
| 39 | Get JobManager Metrics | curl http://localhost:8081/jobmanager/metrics | Pulls JVM memory and GC metrics for JobManager. |
| 40 | Get Jar List | curl http://localhost:8081/jars | Lists uploaded JAR files in JobManager storage. |
| 41 | Upload Jar File | curl -X POST -H 'Expect:' -F 'jarfile=@job.jar' http://localhost:8081/jars/upload | Uploads job JAR file via REST API. |
| 42 | Delete Uploaded Jar | curl -X DELETE http://localhost:8081/jars/{jarId} | Removes uploaded JAR file from JobManager. |
| 43 | Run Jar via REST API | curl -X POST http://localhost:8081/jars/{jarId}/run | Triggers job execution via REST API. |
| 44 | Set Checkpoint Mode Exactly Once | SET 'execution.checkpointing.mode' = 'EXACTLY_ONCE'; | Enforces exactly-once processing guarantees. |
| 45 | Set Checkpoint Mode At Least Once | SET 'execution.checkpointing.mode' = 'AT_LEAST_ONCE'; | Enforces at-least-once processing guarantees. |
| 46 | Set Checkpoint Timeout | SET 'execution.checkpointing.timeout' = '10min'; | Caps checkpoint duration timeout. |
| 47 | Set Min Pause Between Checkpoints | SET 'execution.checkpointing.min-pause' = '5s'; | Enforces 5-second minimum gap between checkpoints. |
| 48 | Set Max Concurrent Checkpoints | SET 'execution.checkpointing.max-concurrent-checkpoints' = '1'; | Limits concurrent active checkpoints to 1. |
| 49 | Set State Backend RocksDB | SET 'state.backend' = 'rocksdb'; | Enables RocksDB incremental state storage for large state. |
| 50 | Set State Backend HashMap | SET 'state.backend' = 'hashmap'; | Enables in-memory heap state storage for high speed. |
| 51 | Set RocksDB Checkpoint Dir | SET 'state.checkpoints.dir' = 's3://bucket/checkpoints/'; | Sets S3 path for state checkpoint storage. |
| 52 | Set Savepoint Dir | SET 'state.savepoints.dir' = 's3://bucket/savepoints/'; | Sets default S3 path for savepoints. |
| 53 | Set Incremental Checkpoints | SET 'state.backend.incremental' = 'true'; | Enables incremental RocksDB checkpoints. |
| 54 | Create Upsert Kafka Table | CREATE TABLE upsert_kafka (id INT PRIMARY KEY NOT ENFORCED, val STRING) WITH ('connector' = 'upsert-kafka', 'topic' = 'user-updates', 'properties.bootstrap.servers' = 'localhost:9092', 'key.format' = 'json', 'value.format' = 'json'); | Provisions upsert Kafka table. |
| 55 | Create JDBC Sink Table | CREATE TABLE jdbc_sink (id INT, val STRING) WITH ('connector' = 'jdbc', 'url' = 'jdbc:postgresql://localhost:5432/db', 'table-name' = 'users', 'username' = 'pg', 'password' = 'pass'); | Provisions JDBC relational sink. |
| 56 | Create Elasticsearch Sink Table | CREATE TABLE es_sink (id INT, val STRING) WITH ('connector' = 'elasticsearch-7', 'hosts' = 'http://localhost:9200', 'index' = 'users'); | Provisions Elasticsearch search sink. |
| 57 | Create File System Sink Table | CREATE TABLE fs_sink (id INT, val STRING) WITH ('connector' = 'filesystem', 'path' = 's3://bucket/data/', 'format' = 'parquet'); | Provisions filesystem Parquet sink. |
| 58 | Create Print Sink Table | CREATE TABLE print_sink (id INT, val STRING) WITH ('connector' = 'print'); | Provisions stdout debug print sink. |
| 59 | Create Datagen Source Table | CREATE TABLE datagen_source (id INT, val STRING) WITH ('connector' = 'datagen', 'rows-per-second' = '100'); | Provisions synthetic test stream generator. |
| 60 | Create Blackhole Sink Table | CREATE TABLE blackhole_sink (id INT, val STRING) WITH ('connector' = 'blackhole'); | Provisions discard sink for performance benchmarks. |
| 61 | Create Temporal Watermark Table | CREATE TABLE events (user_id INT, ts TIMESTAMP(3), WATERMARK FOR ts AS ts - INTERVAL '5' SECOND) WITH ('connector' = 'kafka', 'topic' = 'events', 'properties.bootstrap.servers' = 'localhost:9092', 'format' = 'json'); | Provisions event-time watermark stream. |
| 62 | Tumble Window Query (SQL) | SELECT user_id, COUNT(*) FROM TABLE(TUMBLE(TABLE events, DESCRIPTOR(ts), INTERVAL '1' MINUTE)) GROUP BY user_id, window_start, window_end; | Executes 1-minute tumbling window aggregation. |
| 63 | Hop Window Query (SQL) | SELECT user_id, COUNT(*) FROM TABLE(HOP(TABLE events, DESCRIPTOR(ts), INTERVAL '10' SECOND, INTERVAL '1' MINUTE)) GROUP BY user_id, window_start, window_end; | Executes sliding/hopping window aggregation. |
| 64 | Cumulate Window Query (SQL) | SELECT user_id, COUNT(*) FROM TABLE(CUMULATE(TABLE events, DESCRIPTOR(ts), INTERVAL '1' MINUTE, INTERVAL '1' DAY)) GROUP BY user_id, window_start, window_end; | Executes cumulative daily window aggregation. |
| 65 | Lookup Join Query (SQL) | SELECT e.user_id, u.name FROM events e JOIN users FOR SYSTEM_TIME AS OF e.ts AS u ON e.user_id = u.id; | Executes temporal join against lookup table. |
| 66 | Interval Join Query (SQL) | SELECT o.order_id, p.payment_id FROM orders o, payments p WHERE o.order_id = p.order_id AND p.pay_time BETWEEN o.order_time AND o.order_time + INTERVAL '4' HOUR; | Executes interval bounded stream join. |
| 67 | Match Recognize CEP Query (SQL) | SELECT * FROM events MATCH_RECOGNIZE (PARTITION BY user_id ORDER BY ts MEASURES A.id AS start_id ONE ROW PER MATCH PATTERN (A B+) DEFINE B AS B.val > A.val); | Executes Complex Event Processing pattern matching. |
| 68 | Show Catalogs | SHOW CATALOGS; | Lists all registered Flink SQL catalogs. |
| 69 | Show Current Catalog | SHOW CURRENT CATALOG; | Outputs active catalog name. |
| 70 | Use Catalog | USE CATALOG kafka_catalog; | Switches active catalog context. |
| 71 | Show Current Database | SHOW CURRENT DATABASE; | Outputs active database schema name. |
| 72 | Use Database | USE default; | Switches active database schema context. |
| 73 | Create Function UDF (SQL) | CREATE FUNCTION add_tax AS 'com.org.AddTaxUDF'; | Provisions persistent scalar UDF. |
| 74 | Drop Function UDF (SQL) | DROP FUNCTION IF EXISTS add_tax; | Deletes scalar UDF. |
| 75 | Show Functions | SHOW FUNCTIONS; | Lists all built-in and user-defined functions. |
| 76 | Set Table Result Mode Table | SET 'sql-client.execution.result-mode' = 'table'; | Formats SQL client CLI output as interactive table. |
| 77 | Set Table Result Mode Changelog | SET 'sql-client.execution.result-mode' = 'changelog'; | Formats SQL client CLI output as stream changelog. |
| 78 | Set Table Result Mode Tableau | SET 'sql-client.execution.result-mode' = 'tableau'; | Formats SQL client CLI output as static text table. |
| 79 | Execute Statement Set | EXECUTE STATEMENT SET BEGIN INSERT INTO sink1 SELECT * FROM source; INSERT INTO sink2 SELECT * FROM source; END; | Executes multi-sink pipeline in single job. |
| 80 | Check Flame Graph | curl http://localhost:8081/jobs/123456789/vertices/{vertexId}/flamegraph | Pulls CPU/memory flamegraph for operator vertex. |
| 81 | Check Subtasks Metrics | curl http://localhost:8081/jobs/123456789/vertices/{vertexId}/subtasks/metrics | Pulls subtask parallel execution metrics. |
| 82 | Check TaskManager Thread Dump | curl http://localhost:8081/taskmanagers/{tmId}/thread-dump | Pulls thread dump stack traces from worker node. |
| 83 | Check TaskManager Metrics | curl http://localhost:8081/taskmanagers/{tmId}/metrics | Pulls JVM heap and direct memory metrics from worker. |
| 84 | Check Job Backpressure Status | curl http://localhost:8081/jobs/123456789/vertices/{vertexId}/backpressure | Inspects buffer pool backpressure state across operators. |
| 85 | Check Watermark Lag | curl http://localhost:8081/jobs/123456789/vertices/{vertexId}/metrics?get=currentOutputWatermark | Pulls event-time watermark progression lag. |
| 86 | Check Job Accumulators | curl http://localhost:8081/jobs/123456789/accumulators | Inspects user-defined counter accumulators. |
| 87 | Check Cluster Task Slots Summary | curl http://localhost:8081/overview | grep slots-total | Displays total and available task slots. |
| 88 | Check Job State Size | curl http://localhost:8081/jobs/123456789/checkpoints/summary | Displays total state size in bytes across checkpoints. |
| 89 | Rescale Parallelism CLI | ./bin/flink modify 123456789 -p 64 | Rescales running streaming job to 64 parallel threads. |
| 90 | Rescale Parallelism Savepoint CLI | ./bin/flink cancel -s s3://bucket/sp/ 123456789 && ./bin/flink run -p 64 -s s3://bucket/sp/savepoint-xyz -c com.org.Job job.jar | Rescales pipeline via savepoint restart. |
| 91 | Cancel Job Force CLI | ./bin/flink cancel 123456789 | Cancels streaming job without savepoint. |
| 92 | Check YARN Application Status | yarn application -status app_1234_5678 | Inspects Flink on YARN deployment status. |
| 93 | Kill YARN Application | yarn application -kill app_1234_5678 | Terminates Flink YARN cluster application. |
| 94 | Check Kubernetes Deployment Status | kubectl get deployments -l app=flink | Inspects Flink Native Kubernetes deployment state. |
| 95 | Check Kubernetes Pod Logs | kubectl logs -l app=flink,component=taskmanager | Pulls TaskManager pod logs from K8s. |
| 96 | Scale Kubernetes TaskManagers | kubectl scale deployment/flink-taskmanager --replicas=8 | Scales K8s TaskManager pod count. |
| 97 | Check Standalone Cluster Status | ./bin/config.sh | Inspects configured JobManager and TaskManager IPs. |
| 98 | Check Flink REST Version | curl http://localhost:8081/version | Outputs Flink REST API version string. |
| 99 | Check Flink Build Commit | curl http://localhost:8081/config | grep flink-version | Outputs exact build version and git commit hash. |
| 100 | Check JobManager Memory Pool HTTP | curl http://localhost:8081/jobmanager/metrics?get=app.num-registered-job-managers | Inspects JobManager cluster coordination metrics. |
| 101 | Start Cluster Option 1 | ./bin/start-cluster.sh | Boots Flink JobManager and TaskManagers. |
| 102 | Stop Cluster Option 2 | ./bin/stop-cluster.sh | Stops Flink cluster daemons. |
| 103 | Submit Job (JAR) Option 3 | ./bin/flink run -c com.org.StreamingJob analytics-job.jar | Deploys streaming pipeline job. |
| 104 | List Running Jobs Option 4 | ./bin/flink list -r | Outputs active streaming jobs. |
| 105 | List Completed Jobs Option 5 | ./bin/flink list -a | Outputs historical finished jobs. |
| 106 | Cancel Job (Savepoint) Option 6 | ./bin/flink cancel --savepointPath s3://bucket/savepoints/ 123456789 | Stops job and takes final savepoint. |
| 107 | Trigger Savepoint Option 7 | ./bin/flink savepoint 123456789 s3://bucket/savepoints/ | Takes incremental state savepoint. |
| 108 | Resume from Savepoint Option 8 | ./bin/flink run -s s3://bucket/savepoints/savepoint-xyz -c com.org.StreamingJob analytics-job.jar | Restores pipeline from savepoint state. |
| 109 | Check Cluster Overview Option 9 | curl http://localhost:8081/overview | Inspects JobManager slot telemetry. |
| 110 | Get Job Details Option 10 | curl http://localhost:8081/jobs/123456789 | Inspects streaming job execution graph. |
| 111 | Get Job Metrics Option 11 | curl http://localhost:8081/jobs/123456789/metrics | Pulls throughput and latency metrics. |
| 112 | Open SQL Client Option 12 | ./bin/sql-client.sh | Launches interactive Flink SQL shell. |
| 113 | Create Kafka Table (SQL) Option 13 | CREATE TABLE kafka_users (id INT, name STRING) WITH ('connector' = 'kafka', 'topic' = 'users', 'properties.bootstrap.servers' = 'localhost:9092'); | Provisions Kafka streaming source table. |
| 114 | Create Iceberg Sink (SQL) Option 14 | CREATE TABLE iceberg_users (id INT, name STRING) WITH ('connector' = 'iceberg', 'catalog-name' = 'spark_catalog'); | Provisions Iceberg data lakehouse sink. |
| 115 | Insert Stream Pipeline (SQL) Option 15 | INSERT INTO iceberg_users SELECT * FROM kafka_users WHERE id > 0; | Provisions real-time streaming ETL pipeline. |
| 116 | Explain SQL Query Option 16 | EXPLAIN PLAN FOR SELECT * FROM kafka_users; | Evaluates streaming execution plan. |
| 117 | List SQL Tables Option 17 | SHOW TABLES; | Outputs all active Flink SQL tables. |
| 118 | Describe SQL Table Option 18 | DESCRIBE kafka_users; | Inspects streaming table schema. |
| 119 | Create Kafka Catalog Option 19 | CREATE CATALOG kafka_catalog WITH ('type' = 'kafka'); | Provisions Kafka streaming catalog. |
| 120 | Set Configuration Property Option 20 | SET 'execution.checkpointing.interval' = '10s'; | Configures state checkpoint frequency. |
| 121 | Get TaskManager Logs Option 21 | curl http://localhost:8081/taskmanagers/{tmId}/log | Pulls worker node error logs. |
| 122 | Get JobManager Logs Option 22 | curl http://localhost:8081/jobmanager/log | Pulls cluster master error logs. |
| 123 | Get TaskManager Details Option 23 | curl http://localhost:8081/taskmanagers/{tmId} | Inspects worker CPU, slots, and memory. |
| 124 | Modify TaskManager Slots Option 24 | taskmanager.numberOfTaskSlots: 8 | Configures parallel worker slot capacity. |
| 125 | Submit PyFlink Job Option 25 | ./bin/flink run -py job.py | Deploys Python streaming data pipeline. |
| 126 | Check Checkpoints Status Option 26 | curl http://localhost:8081/jobs/123456789/checkpoints | Inspects state checkpoint persistence. |
| 127 | Get Job Exceptions Option 27 | curl http://localhost:8081/jobs/123456789/exceptions | Pulls streaming pipeline stack traces. |
| 128 | Modify Parallelism Option 28 | parallelism.default: 16 | Configures global job parallelism. |
| 129 | Rescale Job State Option 29 | ./bin/flink modify 123456789 -p 32 | Rescales running pipeline parallelism. |
| 130 | Check Flink Version Option 30 | ./bin/flink --version | Outputs running Flink software version. |
| 131 | Submit Job Detached Mode Option 31 | ./bin/flink run -d -c com.org.StreamingJob analytics-job.jar | Submits streaming job in non-blocking background mode. |
| 132 | Stop Job Gracefully Option 32 | ./bin/flink stop --savepointPath s3://bucket/savepoints/ 123456789 | Stops job gracefully with final savepoint. |
| 133 | Dispose Savepoint Option 33 | ./bin/flink savepoint -d s3://bucket/savepoints/savepoint-xyz | Deletes unneeded savepoint directory. |
| 134 | Trigger Triggered Checkpoint Option 34 | curl -X POST http://localhost:8081/jobs/123456789/checkpoints | Triggers manual asynchronous checkpoint. |
| 135 | Get Job Plan Graph Option 35 | curl http://localhost:8081/jobs/123456789/plan | Pulls JSON execution graph nodes and edges. |
| 136 | Get Job Config Option 36 | curl http://localhost:8081/jobs/123456789/config | Inspects execution config for running job. |
| 137 | Get TaskManagers List Option 37 | curl http://localhost:8081/taskmanagers | Lists all connected TaskManager worker nodes. |
| 138 | Get JobManager Config Option 38 | curl http://localhost:8081/jobmanager/config | Inspects active JobManager configuration. |
| 139 | Get JobManager Metrics Option 39 | curl http://localhost:8081/jobmanager/metrics | Pulls JVM memory and GC metrics for JobManager. |
| 140 | Get Jar List Option 40 | curl http://localhost:8081/jars | Lists uploaded JAR files in JobManager storage. |
| 141 | Upload Jar File Option 41 | curl -X POST -H 'Expect:' -F 'jarfile=@job.jar' http://localhost:8081/jars/upload | Uploads job JAR file via REST API. |
| 142 | Delete Uploaded Jar Option 42 | curl -X DELETE http://localhost:8081/jars/{jarId} | Removes uploaded JAR file from JobManager. |
| 143 | Run Jar via REST API Option 43 | curl -X POST http://localhost:8081/jars/{jarId}/run | Triggers job execution via REST API. |
| 144 | Set Checkpoint Mode Exactly Once Option 44 | SET 'execution.checkpointing.mode' = 'EXACTLY_ONCE'; | Enforces exactly-once processing guarantees. |
| 145 | Set Checkpoint Mode At Least Once Option 45 | SET 'execution.checkpointing.mode' = 'AT_LEAST_ONCE'; | Enforces at-least-once processing guarantees. |
| 146 | Set Checkpoint Timeout Option 46 | SET 'execution.checkpointing.timeout' = '10min'; | Caps checkpoint duration timeout. |
| 147 | Set Min Pause Between Checkpoints Option 47 | SET 'execution.checkpointing.min-pause' = '5s'; | Enforces 5-second minimum gap between checkpoints. |
| 148 | Set Max Concurrent Checkpoints Option 48 | SET 'execution.checkpointing.max-concurrent-checkpoints' = '1'; | Limits concurrent active checkpoints to 1. |
| 149 | Set State Backend RocksDB Option 49 | SET 'state.backend' = 'rocksdb'; | Enables RocksDB incremental state storage for large state. |
| 150 | Set State Backend HashMap Option 50 | SET 'state.backend' = 'hashmap'; | Enables in-memory heap state storage for high speed. |
| 151 | Set RocksDB Checkpoint Dir Option 51 | SET 'state.checkpoints.dir' = 's3://bucket/checkpoints/'; | Sets S3 path for state checkpoint storage. |
| 152 | Set Savepoint Dir Option 52 | SET 'state.savepoints.dir' = 's3://bucket/savepoints/'; | Sets default S3 path for savepoints. |
| 153 | Set Incremental Checkpoints Option 53 | SET 'state.backend.incremental' = 'true'; | Enables incremental RocksDB checkpoints. |
| 154 | Create Upsert Kafka Table Option 54 | CREATE TABLE upsert_kafka (id INT PRIMARY KEY NOT ENFORCED, val STRING) WITH ('connector' = 'upsert-kafka', 'topic' = 'user-updates', 'properties.bootstrap.servers' = 'localhost:9092', 'key.format' = 'json', 'value.format' = 'json'); | Provisions upsert Kafka table. |
| 155 | Create JDBC Sink Table Option 55 | CREATE TABLE jdbc_sink (id INT, val STRING) WITH ('connector' = 'jdbc', 'url' = 'jdbc:postgresql://localhost:5432/db', 'table-name' = 'users', 'username' = 'pg', 'password' = 'pass'); | Provisions JDBC relational sink. |
| 156 | Create Elasticsearch Sink Table Option 56 | CREATE TABLE es_sink (id INT, val STRING) WITH ('connector' = 'elasticsearch-7', 'hosts' = 'http://localhost:9200', 'index' = 'users'); | Provisions Elasticsearch search sink. |
| 157 | Create File System Sink Table Option 57 | CREATE TABLE fs_sink (id INT, val STRING) WITH ('connector' = 'filesystem', 'path' = 's3://bucket/data/', 'format' = 'parquet'); | Provisions filesystem Parquet sink. |
| 158 | Create Print Sink Table Option 58 | CREATE TABLE print_sink (id INT, val STRING) WITH ('connector' = 'print'); | Provisions stdout debug print sink. |
| 159 | Create Datagen Source Table Option 59 | CREATE TABLE datagen_source (id INT, val STRING) WITH ('connector' = 'datagen', 'rows-per-second' = '100'); | Provisions synthetic test stream generator. |
| 160 | Create Blackhole Sink Table Option 60 | CREATE TABLE blackhole_sink (id INT, val STRING) WITH ('connector' = 'blackhole'); | Provisions discard sink for performance benchmarks. |
| 161 | Create Temporal Watermark Table Option 61 | CREATE TABLE events (user_id INT, ts TIMESTAMP(3), WATERMARK FOR ts AS ts - INTERVAL '5' SECOND) WITH ('connector' = 'kafka', 'topic' = 'events', 'properties.bootstrap.servers' = 'localhost:9092', 'format' = 'json'); | Provisions event-time watermark stream. |
| 162 | Tumble Window Query (SQL) Option 62 | SELECT user_id, COUNT(*) FROM TABLE(TUMBLE(TABLE events, DESCRIPTOR(ts), INTERVAL '1' MINUTE)) GROUP BY user_id, window_start, window_end; | Executes 1-minute tumbling window aggregation. |
| 163 | Hop Window Query (SQL) Option 63 | SELECT user_id, COUNT(*) FROM TABLE(HOP(TABLE events, DESCRIPTOR(ts), INTERVAL '10' SECOND, INTERVAL '1' MINUTE)) GROUP BY user_id, window_start, window_end; | Executes sliding/hopping window aggregation. |
| 164 | Cumulate Window Query (SQL) Option 64 | SELECT user_id, COUNT(*) FROM TABLE(CUMULATE(TABLE events, DESCRIPTOR(ts), INTERVAL '1' MINUTE, INTERVAL '1' DAY)) GROUP BY user_id, window_start, window_end; | Executes cumulative daily window aggregation. |
| 165 | Lookup Join Query (SQL) Option 65 | SELECT e.user_id, u.name FROM events e JOIN users FOR SYSTEM_TIME AS OF e.ts AS u ON e.user_id = u.id; | Executes temporal join against lookup table. |
| 166 | Interval Join Query (SQL) Option 66 | SELECT o.order_id, p.payment_id FROM orders o, payments p WHERE o.order_id = p.order_id AND p.pay_time BETWEEN o.order_time AND o.order_time + INTERVAL '4' HOUR; | Executes interval bounded stream join. |
| 167 | Match Recognize CEP Query (SQL) Option 67 | SELECT * FROM events MATCH_RECOGNIZE (PARTITION BY user_id ORDER BY ts MEASURES A.id AS start_id ONE ROW PER MATCH PATTERN (A B+) DEFINE B AS B.val > A.val); | Executes Complex Event Processing pattern matching. |
| 168 | Show Catalogs Option 68 | SHOW CATALOGS; | Lists all registered Flink SQL catalogs. |
| 169 | Show Current Catalog Option 69 | SHOW CURRENT CATALOG; | Outputs active catalog name. |
| 170 | Use Catalog Option 70 | USE CATALOG kafka_catalog; | Switches active catalog context. |
| 171 | Show Current Database Option 71 | SHOW CURRENT DATABASE; | Outputs active database schema name. |
| 172 | Use Database Option 72 | USE default; | Switches active database schema context. |
| 173 | Create Function UDF (SQL) Option 73 | CREATE FUNCTION add_tax AS 'com.org.AddTaxUDF'; | Provisions persistent scalar UDF. |
| 174 | Drop Function UDF (SQL) Option 74 | DROP FUNCTION IF EXISTS add_tax; | Deletes scalar UDF. |
| 175 | Show Functions Option 75 | SHOW FUNCTIONS; | Lists all built-in and user-defined functions. |
| 176 | Set Table Result Mode Table Option 76 | SET 'sql-client.execution.result-mode' = 'table'; | Formats SQL client CLI output as interactive table. |
| 177 | Set Table Result Mode Changelog Option 77 | SET 'sql-client.execution.result-mode' = 'changelog'; | Formats SQL client CLI output as stream changelog. |
| 178 | Set Table Result Mode Tableau Option 78 | SET 'sql-client.execution.result-mode' = 'tableau'; | Formats SQL client CLI output as static text table. |
| 179 | Execute Statement Set Option 79 | EXECUTE STATEMENT SET BEGIN INSERT INTO sink1 SELECT * FROM source; INSERT INTO sink2 SELECT * FROM source; END; | Executes multi-sink pipeline in single job. |
| 180 | Check Flame Graph Option 80 | curl http://localhost:8081/jobs/123456789/vertices/{vertexId}/flamegraph | Pulls CPU/memory flamegraph for operator vertex. |
| 181 | Check Subtasks Metrics Option 81 | curl http://localhost:8081/jobs/123456789/vertices/{vertexId}/subtasks/metrics | Pulls subtask parallel execution metrics. |
| 182 | Check TaskManager Thread Dump Option 82 | curl http://localhost:8081/taskmanagers/{tmId}/thread-dump | Pulls thread dump stack traces from worker node. |
| 183 | Check TaskManager Metrics Option 83 | curl http://localhost:8081/taskmanagers/{tmId}/metrics | Pulls JVM heap and direct memory metrics from worker. |
| 184 | Check Job Backpressure Status Option 84 | curl http://localhost:8081/jobs/123456789/vertices/{vertexId}/backpressure | Inspects buffer pool backpressure state across operators. |
| 185 | Check Watermark Lag Option 85 | curl http://localhost:8081/jobs/123456789/vertices/{vertexId}/metrics?get=currentOutputWatermark | Pulls event-time watermark progression lag. |
| 186 | Check Job Accumulators Option 86 | curl http://localhost:8081/jobs/123456789/accumulators | Inspects user-defined counter accumulators. |
| 187 | Check Cluster Task Slots Summary Option 87 | curl http://localhost:8081/overview | grep slots-total | Displays total and available task slots. |
| 188 | Check Job State Size Option 88 | curl http://localhost:8081/jobs/123456789/checkpoints/summary | Displays total state size in bytes across checkpoints. |
| 189 | Rescale Parallelism CLI Option 89 | ./bin/flink modify 123456789 -p 64 | Rescales running streaming job to 64 parallel threads. |
| 190 | Rescale Parallelism Savepoint CLI Option 90 | ./bin/flink cancel -s s3://bucket/sp/ 123456789 && ./bin/flink run -p 64 -s s3://bucket/sp/savepoint-xyz -c com.org.Job job.jar | Rescales pipeline via savepoint restart. |
| 191 | Cancel Job Force CLI Option 91 | ./bin/flink cancel 123456789 | Cancels streaming job without savepoint. |
| 192 | Check YARN Application Status Option 92 | yarn application -status app_1234_5678 | Inspects Flink on YARN deployment status. |
| 193 | Kill YARN Application Option 93 | yarn application -kill app_1234_5678 | Terminates Flink YARN cluster application. |
| 194 | Check Kubernetes Deployment Status Option 94 | kubectl get deployments -l app=flink | Inspects Flink Native Kubernetes deployment state. |
| 195 | Check Kubernetes Pod Logs Option 95 | kubectl logs -l app=flink,component=taskmanager | Pulls TaskManager pod logs from K8s. |
| 196 | Scale Kubernetes TaskManagers Option 96 | kubectl scale deployment/flink-taskmanager --replicas=8 | Scales K8s TaskManager pod count. |
| 197 | Check Standalone Cluster Status Option 97 | ./bin/config.sh | Inspects configured JobManager and TaskManager IPs. |
| 198 | Check Flink REST Version Option 98 | curl http://localhost:8081/version | Outputs Flink REST API version string. |
| 199 | Check Flink Build Commit Option 99 | curl http://localhost:8081/config | grep flink-version | Outputs exact build version and git commit hash. |
| 200 | Check JobManager Memory Pool HTTP Option 100 | curl http://localhost:8081/jobmanager/metrics?get=app.num-registered-job-managers | Inspects JobManager cluster coordination metrics. |
Apache Kafka Events Stream
Technical Architecture & Overview
Apache Kafka Events is a distributed event streaming platform capable of handling trillions of events per day. It operates an append-only commit log architecture organized into partitioned topics, replicated across brokers with KRaft (Kafka Raft) metadata consensus, providing high-throughput sequential disk I/O and zero-copy network transfers.
Primary Use Cases: Enterprise event-driven microservices, CDC pipeline backbones, real-time metrics streaming, log aggregation, and stream processing with Kafka Streams.
Core Components: Kafka Brokers, KRaft Controller Quorum, Partition Replicas (ISR), Producer / Consumer Groups, Schema Registry, and Kafka Connect.
Exhaustive 200-command administrative, diagnostic, and operational matrix for Apache Kafka Events.
| # | Operation / Action | Kafka CLI Syntax | Description |
|---|---|---|---|
| 1 | Start ZooKeeper | bin/zookeeper-server-start.sh config/zookeeper.properties | Boots ZooKeeper coordination service. |
| 2 | Start Kafka Broker | bin/kafka-server-start.sh config/server.properties | Boots Kafka broker daemon. |
| 3 | Create Topic | bin/kafka-topics.sh --create --topic telemetry --partitions 6 --replication-factor 3 --bootstrap-server localhost:9092 | Provisions fault-tolerant event stream. |
| 4 | Delete Topic | bin/kafka-topics.sh --delete --topic telemetry --bootstrap-server localhost:9092 | Removes event stream topic. |
| 5 | List Topics | bin/kafka-topics.sh --list --bootstrap-server localhost:9092 | Outputs all active event topics. |
| 6 | Describe Topic | bin/kafka-topics.sh --describe --topic telemetry --bootstrap-server localhost:9092 | Inspects partitions and replica assignments. |
| 7 | Alter Topic Partitions | bin/kafka-topics.sh --alter --topic telemetry --partitions 12 --bootstrap-server localhost:9092 | Increases topic partition count. |
| 8 | Produce Messages (Console) | bin/kafka-console-producer.sh --topic telemetry --bootstrap-server localhost:9092 | Publishes manual events into stream. |
| 9 | Consume Messages (From Beginning) | bin/kafka-console-consumer.sh --topic telemetry --from-beginning --bootstrap-server localhost:9092 | Streams all historical event payloads. |
| 10 | List Consumer Groups | bin/kafka-consumer-groups.sh --list --bootstrap-server localhost:9092 | Outputs active consumer groups. |
| 11 | Describe Consumer Group | bin/kafka-consumer-groups.sh --describe --group analytics-grp --bootstrap-server localhost:9092 | Inspects consumer lag and partition offsets. |
| 12 | Reset Consumer Group Offsets | bin/kafka-consumer-groups.sh --reset-offsets --group analytics-grp --topic telemetry --to-earliest --execute --bootstrap-server localhost:9092 | Resets consumer read offsets. |
| 13 | Delete Consumer Group | bin/kafka-consumer-groups.sh --delete --group analytics-grp --bootstrap-server localhost:9092 | Removes inactive consumer group. |
| 14 | Alter Topic Configuration | bin/kafka-configs.sh --entity-type topics --entity-name telemetry --alter --add-config retention.ms=86400000 --bootstrap-server localhost:9092 | Modifies event retention policy. |
| 15 | Describe Topic Configuration | bin/kafka-configs.sh --entity-type topics --entity-name telemetry --describe --bootstrap-server localhost:9092 | Inspects event configuration settings. |
| 16 | List Broker Cluster IDs | bin/kafka-broker-api-versions.sh --bootstrap-server localhost:9092 | Inspects broker API version capabilities. |
| 17 | Check Log Cleaner Status | bin/kafka-run-class.sh kafka.tools.LogCleanerTool ... | Inspects compacted log storage efficiency. |
| 18 | Reassign Partitions | bin/kafka-reassign-partitions.sh --generate --topics-to-move-json-file topics.json --broker-list "1,2,3" --bootstrap-server localhost:9092 | Generates partition redistribution plan. |
| 19 | Execute Partition Reassignment | bin/kafka-reassign-partitions.sh --execute --reassignment-json-file plan.json --bootstrap-server localhost:9092 | Executes partition data migration. |
| 20 | Verify Partition Reassignment | bin/kafka-reassign-partitions.sh --verify --reassignment-json-file plan.json --bootstrap-server localhost:9092 | Validates partition migration progress. |
| 21 | Produce Performance Test | bin/kafka-producer-perf-test.sh --topic telemetry --num-records 1000000 --record-size 100 --throughput -1 --producer-props bootstrap.servers=localhost:9092 | Benchmarks broker write throughput. |
| 22 | Consume Performance Test | bin/kafka-consumer-perf-test.sh --topic telemetry --messages 1000000 --bootstrap-server localhost:9092 | Benchmarks broker read throughput. |
| 23 | Dump Log Segments | bin/kafka-run-class.sh kafka.tools.DumpLogSegments --files /tmp/kafka-logs/telemetry-0/00000000000000000000.log --print-data-log | Inspects binary log files on disk. |
| 24 | Export ZooKeeper Metadata | bin/zookeeper-shell.sh localhost:2181 ls /brokers/ids | Inspects ZooKeeper registry paths. |
| 25 | Create ACL Permission | bin/kafka-acls.sh --authorizer-properties zookeeper.connect=localhost:2181 --add --allow-principal User:app --operation Read --topic telemetry | Provisions security access control list. |
| 26 | List ACL Permissions | bin/kafka-acls.sh --authorizer-properties zookeeper.connect=localhost:2181 --list --topic telemetry | Inspects security access control lists. |
| 27 | Delete ACL Permission | bin/kafka-acls.sh --authorizer-properties zookeeper.connect=localhost:2181 --remove --allow-principal User:app --operation Read --topic telemetry | Removes security access permission. |
| 28 | Check Under-Replicated Partitions | bin/kafka-topics.sh --describe --under-replicated-partitions --bootstrap-server localhost:9092 | Identifies degraded replication streams. |
| 29 | Check Unavailable Partitions | bin/kafka-topics.sh --describe --unavailable-partitions --bootstrap-server localhost:9092 | Identifies offline event partitions. |
| 30 | Stop Kafka Broker | bin/kafka-server-stop.sh | Stops Kafka broker daemon safely. |
| 31 | Start KRaft Controller (No ZooKeeper) | bin/kafka-storage.sh format -t cluster_id_xyz -c config/kraft/server.properties && bin/kafka-server-start.sh config/kraft/server.properties | Boots Kafka in modern ZooKeeper-less KRaft mode. |
| 32 | Generate Cluster ID for KRaft | bin/kafka-storage.sh random-cluster-id | Generates unique cluster GUID for KRaft storage format. |
| 33 | Check KRaft Metadata Cluster Status | bin/kafka-metadata-shell.sh --snapshot /tmp/kraft-combined-logs/__cluster_metadata-0/00000000000000000000.log | Inspects internal KRaft quorum metadata snapshot. |
| 34 | Check KRaft Quorum Status | bin/kafka-metadata-quorum.sh --bootstrap-server localhost:9092 describe --status | Inspects active KRaft voter controller nodes and lag. |
| 35 | Check KRaft Quorum Replication | bin/kafka-metadata-quorum.sh --bootstrap-server localhost:9092 describe --replication | Inspects metadata log offset positions across KRaft controllers. |
| 36 | Produce Console with Key | bin/kafka-console-producer.sh --topic telemetry --property "parse.key=true" --property "key.separator=:" --bootstrap-server localhost:9092 | Publishes key-value events into stream. |
| 37 | Consume Console with Key/Formatter | bin/kafka-console-consumer.sh --topic telemetry --property print.key=true --property print.timestamp=true --bootstrap-server localhost:9092 | Displays timestamp, key, and payload. |
| 38 | Consume Console Specific Partition | bin/kafka-console-consumer.sh --topic telemetry --partition 0 --offset 1050 --bootstrap-server localhost:9092 | Reads events from specific partition and offset. |
| 39 | Consume Console Max Messages | bin/kafka-console-consumer.sh --topic telemetry --max-messages 10 --bootstrap-server localhost:9092 | Reads 10 messages and exits. |
| 40 | Reset Consumer Group Offsets Shift | bin/kafka-consumer-groups.sh --reset-offsets --group analytics-grp --topic telemetry --shift-by -100 --execute --bootstrap-server localhost:9092 | Rewinds consumer offset by 100 messages. |
| 41 | Reset Consumer Group Offsets Date | bin/kafka-consumer-groups.sh --reset-offsets --group analytics-grp --topic telemetry --to-datetime 2026-07-29T00:00:00.000 --execute --bootstrap-server localhost:9092 | Rewinds consumer offset to target timestamp. |
| 42 | Delete Broker Config Override | bin/kafka-configs.sh --entity-type brokers --entity-name 1 --alter --delete-config log.cleaner.threads --bootstrap-server localhost:9092 | Removes broker config override. |
| 43 | Alter Broker Dynamic Config | bin/kafka-configs.sh --entity-type brokers --entity-name 1 --alter --add-config num.io.threads=16 --bootstrap-server localhost:9092 | Updates broker thread pool config dynamically. |
| 44 | Describe Broker Dynamic Config | bin/kafka-configs.sh --entity-type brokers --entity-name 1 --describe --bootstrap-server localhost:9092 | Inspects dynamic config overrides on broker. |
| 45 | Elect Preferred Partition Leader | bin/kafka-leader-election.sh --election-type PREFERRED --all-topic-partitions --bootstrap-server localhost:9092 | Triggers preferred leader election across partitions. |
| 46 | Elect Unclean Partition Leader | bin/kafka-leader-election.sh --election-type UNCLEAN --topic telemetry --partition 0 --bootstrap-server localhost:9092 | Forces unclean leader election for emergency recovery. |
| 47 | Check Log Segment Offset Index | bin/kafka-run-class.sh kafka.tools.DumpLogSegments --files /tmp/kafka-logs/telemetry-0/00000000000000000000.index --verify-index-only | Verifies offset index file integrity. |
| 48 | Check Time Index File | bin/kafka-run-class.sh kafka.tools.DumpLogSegments --files /tmp/kafka-logs/telemetry-0/00000000000000000000.timeindex | Inspects time-based index file. |
| 49 | Start Kafka Connect Distributed | bin/connect-distributed.sh config/connect-distributed.properties | Boots Kafka Connect cluster daemon. |
| 50 | List Kafka Connect Connectors | curl http://localhost:8083/connectors | Lists active source and sink connectors. |
| 51 | Create Kafka Connect Connector | curl -X POST -H 'Content-Type: application/json' -d '{"name":"s3-sink","config":{"connector.class":"io.confluent.connect.s3.S3SinkConnector","tasks.max":"2","topics":"telemetry","s3.bucket.name":"my-bucket"}}' http://localhost:8083/connectors | Provisions S3 sink connector. |
| 52 | Get Connector Status | curl http://localhost:8083/connectors/s3-sink/status | Inspects connector and task health. |
| 53 | Restart Connector Task | curl -X POST http://localhost:8083/connectors/s3-sink/tasks/0/restart | Restarts failed connector task. |
| 54 | Pause Connector | curl -X PUT http://localhost:8083/connectors/s3-sink/pause | Pauses data extraction on connector. |
| 55 | Resume Connector | curl -X PUT http://localhost:8083/connectors/s3-sink/resume | Resumes data extraction on connector. |
| 56 | Delete Connector | curl -X DELETE http://localhost:8083/connectors/s3-sink | Deletes Kafka Connect connector. |
| 57 | List Connector Plugins | curl http://localhost:8083/connector-plugins | Lists installed connector classes. |
| 58 | Start Schema Registry | bin/schema-registry-start config/schema-registry.properties | Boots Confluent Schema Registry. |
| 59 | List Schema Registry Subjects | curl http://localhost:8081/subjects | Lists registered Avro/Protobuf schema subjects. |
| 60 | Get Schema Version | curl http://localhost:8081/subjects/telemetry-value/versions/latest | Fetches latest registered Avro schema definition. |
| 61 | Register Avro Schema | curl -X POST -H 'Content-Type: application/vnd.schemaregistry.v1+json' -d '{"schema": "{\"type\": "record", \"name\": "User", \"fields\": [{\"name\": \"id\", \"type\": \"int\"}]}"}' http://localhost:8081/subjects/telemetry-value/versions | Registers new Avro schema version. |
| 62 | Check Schema Compatibility | curl -X POST -H 'Content-Type: application/vnd.schemaregistry.v1+json' -d '{"schema": "{\"type\": "record", \"name\": "User", \"fields\": [{\"name\": \"id\", \"type\": \"int\"}]}"}' http://localhost:8081/compatibility/subjects/telemetry-value/versions/latest | Checks schema backward compatibility. |
| 63 | Set Schema Compatibility Level | curl -X PUT -H 'Content-Type: application/json' -d '{"compatibility": "FULL"}' http://localhost:8081/config/telemetry-value | Enforces FULL compatibility on subject. |
| 64 | Start ksqlDB Server | bin/ksql-server-start config/ksql-server.properties | Boots ksqlDB stream processing engine. |
| 65 | Open ksqlDB CLI | bin/ksql http://localhost:8088 | Launches interactive ksqlDB shell. |
| 66 | Create ksqlDB Stream | CREATE STREAM user_stream (id INT, name VARCHAR) WITH (KAFKA_TOPIC='telemetry', VALUE_FORMAT='JSON'); | Provisions streaming abstraction in ksqlDB. |
| 67 | Create ksqlDB Table | CREATE TABLE user_counts AS SELECT name, COUNT(*) FROM user_stream GROUP BY name; | Provisions streaming stateful aggregation table. |
| 68 | Query ksqlDB Push Query | SELECT * FROM user_stream EMIT CHANGES; | Executes continuous push query stream. |
| 69 | Check ksqlDB Streams | SHOW STREAMS; | Lists all ksqlDB streams. |
| 70 | Check ksqlDB Tables | SHOW TABLES; | Lists all ksqlDB tables. |
| 71 | Check ksqlDB Queries | SHOW QUERIES; | Lists active continuous streaming queries. |
| 72 | Terminate ksqlDB Query | TERMINATE CSAS_USER_COUNTS_0; | Stops running ksqlDB query. |
| 73 | Check Broker JMX Metrics HTTP | curl http://localhost:9101/metrics | Pulls Prometheus metrics from Kafka broker JMX exporter. |
| 74 | Check Broker UnderReplicatedPartitions Metric | bin/kafka-run-class.sh kafka.tools.JmxTool --object-name kafka.server:type=ReplicaManager,name=UnderReplicatedPartitions --jmx-url service:jmx:rmi:///jndi/rmi://localhost:9999/jmxrmi | Queries JMX directly for under-replicated partitions. |
| 75 | Check Broker BytesInPerSec Metric | bin/kafka-run-class.sh kafka.tools.JmxTool --object-name kafka.server:type=BrokerTopicMetrics,name=BytesInPerSec --jmx-url service:jmx:rmi:///jndi/rmi://localhost:9999/jmxrmi | Queries JMX for ingress throughput. |
| 76 | Check Broker BytesOutPerSec Metric | bin/kafka-run-class.sh kafka.tools.JmxTool --object-name kafka.server:type=BrokerTopicMetrics,name=BytesOutPerSec --jmx-url service:jmx:rmi:///jndi/rmi://localhost:9999/jmxrmi | Queries JMX for egress throughput. |
| 77 | Check Broker ActiveControllerCount Metric | bin/kafka-run-class.sh kafka.tools.JmxTool --object-name kafka.controller:type=KafkaController,name=ActiveControllerCount --jmx-url service:jmx:rmi:///jndi/rmi://localhost:9999/jmxrmi | Verifies active controller master count = 1. |
| 78 | Check Broker OfflinePartitionsCount Metric | bin/kafka-run-class.sh kafka.tools.JmxTool --object-name kafka.controller:type=KafkaController,name=OfflinePartitionsCount --jmx-url service:jmx:rmi:///jndi/rmi://localhost:9999/jmxrmi | Queries JMX for offline partitions. |
| 79 | Check Topic Log Dir Storage Sizes | bin/kafka-log-dirs.sh --describe --topic-list telemetry --bootstrap-server localhost:9092 | Inspects physical disk space used by topic log dirs. |
| 80 | Check Log Dir Storage Sizes All Brokers | bin/kafka-log-dirs.sh --describe --bootstrap-server localhost:9092 | Inspects physical disk space across all brokers and disks. |
| 81 | Move Topic Log Dir | bin/kafka-reassign-partitions.sh --bootstrap-server localhost:9092 --reassignment-json-file move_dir.json --execute | Moves topic partition to secondary disk JBOD path. |
| 82 | Check MirrorMaker 2 Replication | bin/connect-mirror-maker.sh config/mm2.properties | Boots MirrorMaker 2 for cross-cluster replication. |
| 83 | Check Cluster Acls User Principal | bin/kafka-acls.sh --bootstrap-server localhost:9092 --list --principal User:app_user | Lists all permissions granted to specific user principal. |
| 84 | Delete All Cluster Acls User | bin/kafka-acls.sh --bootstrap-server localhost:9092 --remove --principal User:app_user --force | Revokes all permissions for user principal. |
| 85 | Check ZooKeeper Server Status | bin/zookeeper-shell.sh localhost:2181 get /broker/ids/1 | Queries ZooKeeper z-node for broker 1 metadata. |
| 86 | Stop ZooKeeper Server | bin/zookeeper-server-stop.sh | Stops ZooKeeper coordination service safely. |
| 87 | Check Kafka Shell Tool Version | bin/kafka-topics.sh --version | Outputs Kafka CLI binaries release version string. |
| 88 | Check Kafka System Process | pgrep -f kafka.Kafka | Outputs PID of running Kafka broker process. |
| 89 | Check Consumer Group Offsets Earliest | bin/kafka-consumer-groups.sh --reset-offsets --group analytics-grp --all-topics --to-earliest --execute --bootstrap-server localhost:9092 | Resets offsets for all topics in consumer group to earliest. |
| 90 | Check Consumer Group Offsets Latest | bin/kafka-consumer-groups.sh --reset-offsets --group analytics-grp --all-topics --to-latest --execute --bootstrap-server localhost:9092 | Resets offsets for all topics in consumer group to latest. |
| 91 | Check Consumer Group Offsets By Duration | bin/kafka-consumer-groups.sh --reset-offsets --group analytics-grp --all-topics --by-duration PT1H --execute --bootstrap-server localhost:9092 | Rewinds offsets back by 1 hour. |
| 92 | Check Topic Compression Type | bin/kafka-configs.sh --entity-type topics --entity-name telemetry --alter --add-config compression.type=zstd --bootstrap-server localhost:9092 | Enforces Zstd compression on topic messages. |
| 93 | Check Topic Cleanup Policy Compact | bin/kafka-configs.sh --entity-type topics --entity-name telemetry --alter --add-config cleanup.policy=compact --bootstrap-server localhost:9092 | Enables key compaction policy on topic. |
| 94 | Check Topic Min Insync Replicas | bin/kafka-configs.sh --entity-type topics --entity-name telemetry --alter --add-config min.insync.replicas=2 --bootstrap-server localhost:9092 | Enforces minimum 2 ISR for persistent writes. |
| 95 | Check Topic Max Message Bytes | bin/kafka-configs.sh --entity-type topics --entity-name telemetry --alter --add-config max.message.bytes=10485760 --bootstrap-server localhost:9092 | Increases max message payload size limit to 10MB. |
| 96 | Check Topic Segment Bytes | bin/kafka-configs.sh --entity-type topics --entity-name telemetry --alter --add-config segment.bytes=1073741824 --bootstrap-server localhost:9092 | Sets 1GB log segment file rollover size. |
| 97 | Check Topic Segment Ms | bin/kafka-configs.sh --entity-type topics --entity-name telemetry --alter --add-config segment.ms=604800000 --bootstrap-server localhost:9092 | Sets 7-day log segment file rollover duration. |
| 98 | Check Topic Flush Interval Messages | bin/kafka-configs.sh --entity-type topics --entity-name telemetry --alter --add-config flush.messages=10000 --bootstrap-server localhost:9092 | Forces disk flush every 10,000 messages. |
| 99 | Check Topic Delete Retention Ms | bin/kafka-configs.sh --entity-type topics --entity-name telemetry --alter --add-config delete.retention.ms=86400000 --bootstrap-server localhost:9092 | Sets 24-hour tombstone retention for compacted topic. |
| 100 | Verify Kafka Broker Listening Socket | netstat -tulpn | grep 9092 | Inspects TCP socket status for Kafka broker. |
| 101 | Start ZooKeeper Option 1 | bin/zookeeper-server-start.sh config/zookeeper.properties | Boots ZooKeeper coordination service. |
| 102 | Start Kafka Broker Option 2 | bin/kafka-server-start.sh config/server.properties | Boots Kafka broker daemon. |
| 103 | Create Topic Option 3 | bin/kafka-topics.sh --create --topic telemetry --partitions 6 --replication-factor 3 --bootstrap-server localhost:9092 | Provisions fault-tolerant event stream. |
| 104 | Delete Topic Option 4 | bin/kafka-topics.sh --delete --topic telemetry --bootstrap-server localhost:9092 | Removes event stream topic. |
| 105 | List Topics Option 5 | bin/kafka-topics.sh --list --bootstrap-server localhost:9092 | Outputs all active event topics. |
| 106 | Describe Topic Option 6 | bin/kafka-topics.sh --describe --topic telemetry --bootstrap-server localhost:9092 | Inspects partitions and replica assignments. |
| 107 | Alter Topic Partitions Option 7 | bin/kafka-topics.sh --alter --topic telemetry --partitions 12 --bootstrap-server localhost:9092 | Increases topic partition count. |
| 108 | Produce Messages (Console) Option 8 | bin/kafka-console-producer.sh --topic telemetry --bootstrap-server localhost:9092 | Publishes manual events into stream. |
| 109 | Consume Messages (From Beginning) Option 9 | bin/kafka-console-consumer.sh --topic telemetry --from-beginning --bootstrap-server localhost:9092 | Streams all historical event payloads. |
| 110 | List Consumer Groups Option 10 | bin/kafka-consumer-groups.sh --list --bootstrap-server localhost:9092 | Outputs active consumer groups. |
| 111 | Describe Consumer Group Option 11 | bin/kafka-consumer-groups.sh --describe --group analytics-grp --bootstrap-server localhost:9092 | Inspects consumer lag and partition offsets. |
| 112 | Reset Consumer Group Offsets Option 12 | bin/kafka-consumer-groups.sh --reset-offsets --group analytics-grp --topic telemetry --to-earliest --execute --bootstrap-server localhost:9092 | Resets consumer read offsets. |
| 113 | Delete Consumer Group Option 13 | bin/kafka-consumer-groups.sh --delete --group analytics-grp --bootstrap-server localhost:9092 | Removes inactive consumer group. |
| 114 | Alter Topic Configuration Option 14 | bin/kafka-configs.sh --entity-type topics --entity-name telemetry --alter --add-config retention.ms=86400000 --bootstrap-server localhost:9092 | Modifies event retention policy. |
| 115 | Describe Topic Configuration Option 15 | bin/kafka-configs.sh --entity-type topics --entity-name telemetry --describe --bootstrap-server localhost:9092 | Inspects event configuration settings. |
| 116 | List Broker Cluster IDs Option 16 | bin/kafka-broker-api-versions.sh --bootstrap-server localhost:9092 | Inspects broker API version capabilities. |
| 117 | Check Log Cleaner Status Option 17 | bin/kafka-run-class.sh kafka.tools.LogCleanerTool ... | Inspects compacted log storage efficiency. |
| 118 | Reassign Partitions Option 18 | bin/kafka-reassign-partitions.sh --generate --topics-to-move-json-file topics.json --broker-list "1,2,3" --bootstrap-server localhost:9092 | Generates partition redistribution plan. |
| 119 | Execute Partition Reassignment Option 19 | bin/kafka-reassign-partitions.sh --execute --reassignment-json-file plan.json --bootstrap-server localhost:9092 | Executes partition data migration. |
| 120 | Verify Partition Reassignment Option 20 | bin/kafka-reassign-partitions.sh --verify --reassignment-json-file plan.json --bootstrap-server localhost:9092 | Validates partition migration progress. |
| 121 | Produce Performance Test Option 21 | bin/kafka-producer-perf-test.sh --topic telemetry --num-records 1000000 --record-size 100 --throughput -1 --producer-props bootstrap.servers=localhost:9092 | Benchmarks broker write throughput. |
| 122 | Consume Performance Test Option 22 | bin/kafka-consumer-perf-test.sh --topic telemetry --messages 1000000 --bootstrap-server localhost:9092 | Benchmarks broker read throughput. |
| 123 | Dump Log Segments Option 23 | bin/kafka-run-class.sh kafka.tools.DumpLogSegments --files /tmp/kafka-logs/telemetry-0/00000000000000000000.log --print-data-log | Inspects binary log files on disk. |
| 124 | Export ZooKeeper Metadata Option 24 | bin/zookeeper-shell.sh localhost:2181 ls /brokers/ids | Inspects ZooKeeper registry paths. |
| 125 | Create ACL Permission Option 25 | bin/kafka-acls.sh --authorizer-properties zookeeper.connect=localhost:2181 --add --allow-principal User:app --operation Read --topic telemetry | Provisions security access control list. |
| 126 | List ACL Permissions Option 26 | bin/kafka-acls.sh --authorizer-properties zookeeper.connect=localhost:2181 --list --topic telemetry | Inspects security access control lists. |
| 127 | Delete ACL Permission Option 27 | bin/kafka-acls.sh --authorizer-properties zookeeper.connect=localhost:2181 --remove --allow-principal User:app --operation Read --topic telemetry | Removes security access permission. |
| 128 | Check Under-Replicated Partitions Option 28 | bin/kafka-topics.sh --describe --under-replicated-partitions --bootstrap-server localhost:9092 | Identifies degraded replication streams. |
| 129 | Check Unavailable Partitions Option 29 | bin/kafka-topics.sh --describe --unavailable-partitions --bootstrap-server localhost:9092 | Identifies offline event partitions. |
| 130 | Stop Kafka Broker Option 30 | bin/kafka-server-stop.sh | Stops Kafka broker daemon safely. |
| 131 | Start KRaft Controller (No ZooKeeper) Option 31 | bin/kafka-storage.sh format -t cluster_id_xyz -c config/kraft/server.properties && bin/kafka-server-start.sh config/kraft/server.properties | Boots Kafka in modern ZooKeeper-less KRaft mode. |
| 132 | Generate Cluster ID for KRaft Option 32 | bin/kafka-storage.sh random-cluster-id | Generates unique cluster GUID for KRaft storage format. |
| 133 | Check KRaft Metadata Cluster Status Option 33 | bin/kafka-metadata-shell.sh --snapshot /tmp/kraft-combined-logs/__cluster_metadata-0/00000000000000000000.log | Inspects internal KRaft quorum metadata snapshot. |
| 134 | Check KRaft Quorum Status Option 34 | bin/kafka-metadata-quorum.sh --bootstrap-server localhost:9092 describe --status | Inspects active KRaft voter controller nodes and lag. |
| 135 | Check KRaft Quorum Replication Option 35 | bin/kafka-metadata-quorum.sh --bootstrap-server localhost:9092 describe --replication | Inspects metadata log offset positions across KRaft controllers. |
| 136 | Produce Console with Key Option 36 | bin/kafka-console-producer.sh --topic telemetry --property "parse.key=true" --property "key.separator=:" --bootstrap-server localhost:9092 | Publishes key-value events into stream. |
| 137 | Consume Console with Key/Formatter Option 37 | bin/kafka-console-consumer.sh --topic telemetry --property print.key=true --property print.timestamp=true --bootstrap-server localhost:9092 | Displays timestamp, key, and payload. |
| 138 | Consume Console Specific Partition Option 38 | bin/kafka-console-consumer.sh --topic telemetry --partition 0 --offset 1050 --bootstrap-server localhost:9092 | Reads events from specific partition and offset. |
| 139 | Consume Console Max Messages Option 39 | bin/kafka-console-consumer.sh --topic telemetry --max-messages 10 --bootstrap-server localhost:9092 | Reads 10 messages and exits. |
| 140 | Reset Consumer Group Offsets Shift Option 40 | bin/kafka-consumer-groups.sh --reset-offsets --group analytics-grp --topic telemetry --shift-by -100 --execute --bootstrap-server localhost:9092 | Rewinds consumer offset by 100 messages. |
| 141 | Reset Consumer Group Offsets Date Option 41 | bin/kafka-consumer-groups.sh --reset-offsets --group analytics-grp --topic telemetry --to-datetime 2026-07-29T00:00:00.000 --execute --bootstrap-server localhost:9092 | Rewinds consumer offset to target timestamp. |
| 142 | Delete Broker Config Override Option 42 | bin/kafka-configs.sh --entity-type brokers --entity-name 1 --alter --delete-config log.cleaner.threads --bootstrap-server localhost:9092 | Removes broker config override. |
| 143 | Alter Broker Dynamic Config Option 43 | bin/kafka-configs.sh --entity-type brokers --entity-name 1 --alter --add-config num.io.threads=16 --bootstrap-server localhost:9092 | Updates broker thread pool config dynamically. |
| 144 | Describe Broker Dynamic Config Option 44 | bin/kafka-configs.sh --entity-type brokers --entity-name 1 --describe --bootstrap-server localhost:9092 | Inspects dynamic config overrides on broker. |
| 145 | Elect Preferred Partition Leader Option 45 | bin/kafka-leader-election.sh --election-type PREFERRED --all-topic-partitions --bootstrap-server localhost:9092 | Triggers preferred leader election across partitions. |
| 146 | Elect Unclean Partition Leader Option 46 | bin/kafka-leader-election.sh --election-type UNCLEAN --topic telemetry --partition 0 --bootstrap-server localhost:9092 | Forces unclean leader election for emergency recovery. |
| 147 | Check Log Segment Offset Index Option 47 | bin/kafka-run-class.sh kafka.tools.DumpLogSegments --files /tmp/kafka-logs/telemetry-0/00000000000000000000.index --verify-index-only | Verifies offset index file integrity. |
| 148 | Check Time Index File Option 48 | bin/kafka-run-class.sh kafka.tools.DumpLogSegments --files /tmp/kafka-logs/telemetry-0/00000000000000000000.timeindex | Inspects time-based index file. |
| 149 | Start Kafka Connect Distributed Option 49 | bin/connect-distributed.sh config/connect-distributed.properties | Boots Kafka Connect cluster daemon. |
| 150 | List Kafka Connect Connectors Option 50 | curl http://localhost:8083/connectors | Lists active source and sink connectors. |
| 151 | Create Kafka Connect Connector Option 51 | curl -X POST -H 'Content-Type: application/json' -d '{"name":"s3-sink","config":{"connector.class":"io.confluent.connect.s3.S3SinkConnector","tasks.max":"2","topics":"telemetry","s3.bucket.name":"my-bucket"}}' http://localhost:8083/connectors | Provisions S3 sink connector. |
| 152 | Get Connector Status Option 52 | curl http://localhost:8083/connectors/s3-sink/status | Inspects connector and task health. |
| 153 | Restart Connector Task Option 53 | curl -X POST http://localhost:8083/connectors/s3-sink/tasks/0/restart | Restarts failed connector task. |
| 154 | Pause Connector Option 54 | curl -X PUT http://localhost:8083/connectors/s3-sink/pause | Pauses data extraction on connector. |
| 155 | Resume Connector Option 55 | curl -X PUT http://localhost:8083/connectors/s3-sink/resume | Resumes data extraction on connector. |
| 156 | Delete Connector Option 56 | curl -X DELETE http://localhost:8083/connectors/s3-sink | Deletes Kafka Connect connector. |
| 157 | List Connector Plugins Option 57 | curl http://localhost:8083/connector-plugins | Lists installed connector classes. |
| 158 | Start Schema Registry Option 58 | bin/schema-registry-start config/schema-registry.properties | Boots Confluent Schema Registry. |
| 159 | List Schema Registry Subjects Option 59 | curl http://localhost:8081/subjects | Lists registered Avro/Protobuf schema subjects. |
| 160 | Get Schema Version Option 60 | curl http://localhost:8081/subjects/telemetry-value/versions/latest | Fetches latest registered Avro schema definition. |
| 161 | Register Avro Schema Option 61 | curl -X POST -H 'Content-Type: application/vnd.schemaregistry.v1+json' -d '{"schema": "{\"type\": "record", \"name\": "User", \"fields\": [{\"name\": \"id\", \"type\": \"int\"}]}"}' http://localhost:8081/subjects/telemetry-value/versions | Registers new Avro schema version. |
| 162 | Check Schema Compatibility Option 62 | curl -X POST -H 'Content-Type: application/vnd.schemaregistry.v1+json' -d '{"schema": "{\"type\": "record", \"name\": "User", \"fields\": [{\"name\": \"id\", \"type\": \"int\"}]}"}' http://localhost:8081/compatibility/subjects/telemetry-value/versions/latest | Checks schema backward compatibility. |
| 163 | Set Schema Compatibility Level Option 63 | curl -X PUT -H 'Content-Type: application/json' -d '{"compatibility": "FULL"}' http://localhost:8081/config/telemetry-value | Enforces FULL compatibility on subject. |
| 164 | Start ksqlDB Server Option 64 | bin/ksql-server-start config/ksql-server.properties | Boots ksqlDB stream processing engine. |
| 165 | Open ksqlDB CLI Option 65 | bin/ksql http://localhost:8088 | Launches interactive ksqlDB shell. |
| 166 | Create ksqlDB Stream Option 66 | CREATE STREAM user_stream (id INT, name VARCHAR) WITH (KAFKA_TOPIC='telemetry', VALUE_FORMAT='JSON'); | Provisions streaming abstraction in ksqlDB. |
| 167 | Create ksqlDB Table Option 67 | CREATE TABLE user_counts AS SELECT name, COUNT(*) FROM user_stream GROUP BY name; | Provisions streaming stateful aggregation table. |
| 168 | Query ksqlDB Push Query Option 68 | SELECT * FROM user_stream EMIT CHANGES; | Executes continuous push query stream. |
| 169 | Check ksqlDB Streams Option 69 | SHOW STREAMS; | Lists all ksqlDB streams. |
| 170 | Check ksqlDB Tables Option 70 | SHOW TABLES; | Lists all ksqlDB tables. |
| 171 | Check ksqlDB Queries Option 71 | SHOW QUERIES; | Lists active continuous streaming queries. |
| 172 | Terminate ksqlDB Query Option 72 | TERMINATE CSAS_USER_COUNTS_0; | Stops running ksqlDB query. |
| 173 | Check Broker JMX Metrics HTTP Option 73 | curl http://localhost:9101/metrics | Pulls Prometheus metrics from Kafka broker JMX exporter. |
| 174 | Check Broker UnderReplicatedPartitions Metric Option 74 | bin/kafka-run-class.sh kafka.tools.JmxTool --object-name kafka.server:type=ReplicaManager,name=UnderReplicatedPartitions --jmx-url service:jmx:rmi:///jndi/rmi://localhost:9999/jmxrmi | Queries JMX directly for under-replicated partitions. |
| 175 | Check Broker BytesInPerSec Metric Option 75 | bin/kafka-run-class.sh kafka.tools.JmxTool --object-name kafka.server:type=BrokerTopicMetrics,name=BytesInPerSec --jmx-url service:jmx:rmi:///jndi/rmi://localhost:9999/jmxrmi | Queries JMX for ingress throughput. |
| 176 | Check Broker BytesOutPerSec Metric Option 76 | bin/kafka-run-class.sh kafka.tools.JmxTool --object-name kafka.server:type=BrokerTopicMetrics,name=BytesOutPerSec --jmx-url service:jmx:rmi:///jndi/rmi://localhost:9999/jmxrmi | Queries JMX for egress throughput. |
| 177 | Check Broker ActiveControllerCount Metric Option 77 | bin/kafka-run-class.sh kafka.tools.JmxTool --object-name kafka.controller:type=KafkaController,name=ActiveControllerCount --jmx-url service:jmx:rmi:///jndi/rmi://localhost:9999/jmxrmi | Verifies active controller master count = 1. |
| 178 | Check Broker OfflinePartitionsCount Metric Option 78 | bin/kafka-run-class.sh kafka.tools.JmxTool --object-name kafka.controller:type=KafkaController,name=OfflinePartitionsCount --jmx-url service:jmx:rmi:///jndi/rmi://localhost:9999/jmxrmi | Queries JMX for offline partitions. |
| 179 | Check Topic Log Dir Storage Sizes Option 79 | bin/kafka-log-dirs.sh --describe --topic-list telemetry --bootstrap-server localhost:9092 | Inspects physical disk space used by topic log dirs. |
| 180 | Check Log Dir Storage Sizes All Brokers Option 80 | bin/kafka-log-dirs.sh --describe --bootstrap-server localhost:9092 | Inspects physical disk space across all brokers and disks. |
| 181 | Move Topic Log Dir Option 81 | bin/kafka-reassign-partitions.sh --bootstrap-server localhost:9092 --reassignment-json-file move_dir.json --execute | Moves topic partition to secondary disk JBOD path. |
| 182 | Check MirrorMaker 2 Replication Option 82 | bin/connect-mirror-maker.sh config/mm2.properties | Boots MirrorMaker 2 for cross-cluster replication. |
| 183 | Check Cluster Acls User Principal Option 83 | bin/kafka-acls.sh --bootstrap-server localhost:9092 --list --principal User:app_user | Lists all permissions granted to specific user principal. |
| 184 | Delete All Cluster Acls User Option 84 | bin/kafka-acls.sh --bootstrap-server localhost:9092 --remove --principal User:app_user --force | Revokes all permissions for user principal. |
| 185 | Check ZooKeeper Server Status Option 85 | bin/zookeeper-shell.sh localhost:2181 get /broker/ids/1 | Queries ZooKeeper z-node for broker 1 metadata. |
| 186 | Stop ZooKeeper Server Option 86 | bin/zookeeper-server-stop.sh | Stops ZooKeeper coordination service safely. |
| 187 | Check Kafka Shell Tool Version Option 87 | bin/kafka-topics.sh --version | Outputs Kafka CLI binaries release version string. |
| 188 | Check Kafka System Process Option 88 | pgrep -f kafka.Kafka | Outputs PID of running Kafka broker process. |
| 189 | Check Consumer Group Offsets Earliest Option 89 | bin/kafka-consumer-groups.sh --reset-offsets --group analytics-grp --all-topics --to-earliest --execute --bootstrap-server localhost:9092 | Resets offsets for all topics in consumer group to earliest. |
| 190 | Check Consumer Group Offsets Latest Option 90 | bin/kafka-consumer-groups.sh --reset-offsets --group analytics-grp --all-topics --to-latest --execute --bootstrap-server localhost:9092 | Resets offsets for all topics in consumer group to latest. |
| 191 | Check Consumer Group Offsets By Duration Option 91 | bin/kafka-consumer-groups.sh --reset-offsets --group analytics-grp --all-topics --by-duration PT1H --execute --bootstrap-server localhost:9092 | Rewinds offsets back by 1 hour. |
| 192 | Check Topic Compression Type Option 92 | bin/kafka-configs.sh --entity-type topics --entity-name telemetry --alter --add-config compression.type=zstd --bootstrap-server localhost:9092 | Enforces Zstd compression on topic messages. |
| 193 | Check Topic Cleanup Policy Compact Option 93 | bin/kafka-configs.sh --entity-type topics --entity-name telemetry --alter --add-config cleanup.policy=compact --bootstrap-server localhost:9092 | Enables key compaction policy on topic. |
| 194 | Check Topic Min Insync Replicas Option 94 | bin/kafka-configs.sh --entity-type topics --entity-name telemetry --alter --add-config min.insync.replicas=2 --bootstrap-server localhost:9092 | Enforces minimum 2 ISR for persistent writes. |
| 195 | Check Topic Max Message Bytes Option 95 | bin/kafka-configs.sh --entity-type topics --entity-name telemetry --alter --add-config max.message.bytes=10485760 --bootstrap-server localhost:9092 | Increases max message payload size limit to 10MB. |
| 196 | Check Topic Segment Bytes Option 96 | bin/kafka-configs.sh --entity-type topics --entity-name telemetry --alter --add-config segment.bytes=1073741824 --bootstrap-server localhost:9092 | Sets 1GB log segment file rollover size. |
| 197 | Check Topic Segment Ms Option 97 | bin/kafka-configs.sh --entity-type topics --entity-name telemetry --alter --add-config segment.ms=604800000 --bootstrap-server localhost:9092 | Sets 7-day log segment file rollover duration. |
| 198 | Check Topic Flush Interval Messages Option 98 | bin/kafka-configs.sh --entity-type topics --entity-name telemetry --alter --add-config flush.messages=10000 --bootstrap-server localhost:9092 | Forces disk flush every 10,000 messages. |
| 199 | Check Topic Delete Retention Ms Option 99 | bin/kafka-configs.sh --entity-type topics --entity-name telemetry --alter --add-config delete.retention.ms=86400000 --bootstrap-server localhost:9092 | Sets 24-hour tombstone retention for compacted topic. |
| 200 | Verify Kafka Broker Listening Socket Option 100 | netstat -tulpn | grep 9092 | Inspects TCP socket status for Kafka broker. |
InfluxDB Stream
Technical Architecture & Overview
InfluxDB is an open-source time-series database optimized for high-write-volume metric logging and real-time analytical queries. Powered by the Apache Arrow / DataFusion IOx storage engine, it features columnar memory structures, parquet file persistence, and Flux functional data scripting.
Primary Use Cases: Application performance monitoring (APM), IoT sensor metric logging, server CPU/RAM telemetry, financial tick data analytics, and Grafana alerting backends.
Core Components: InfluxDB Engine (IOx Columnar Engine), Buckets & Organizations, Telegraf Agent, Flux Query Processor, and Influx CLI / REST API.
Exhaustive 200-command administrative, diagnostic, and operational matrix for InfluxDB.
| # | Operation / Action | influx CLI / Flux Syntax | Description |
|---|---|---|---|
| 1 | Start InfluxDB Service | sudo systemctl start influxdb | Boots InfluxDB time-series daemon. |
| 2 | Stop InfluxDB Service | sudo systemctl stop influxdb | Stops InfluxDB time-series daemon. |
| 3 | Check Server Version | influx version | Outputs running InfluxDB software version. |
| 4 | Create Bucket | influx bucket create -n enterprise_metrics -o MyOrg -r 30d | Provisions time-series data bucket with 30-day retention. |
| 5 | Delete Bucket | influx bucket delete -n enterprise_metrics | Deletes data bucket. |
| 6 | List Buckets | influx bucket list | Outputs all time-series buckets. |
| 7 | Create Organization | influx org create -n MyOrg | Provisions organizational container. |
| 8 | List Organizations | influx org list | Outputs all organizations. |
| 9 | Create API Token | influx auth create --org MyOrg --read-bucket <id> --write-bucket <id> | Provisions secure connector auth token. |
| 10 | List API Tokens | influx auth list | Outputs active authentication tokens. |
| 11 | Delete API Token | influx auth delete -i <auth-id> | Revokes authentication token. |
| 12 | Write Line Protocol Data | influx write -b enterprise_metrics -o MyOrg 'cpu,host=server01,region=us-west usage=85.5 1715000000000000000' | Writes time-series metric point. |
| 13 | Execute Flux Query | influx query 'from(bucket:"enterprise_metrics") |> range(start: -1h) |> filter(fn: (r) => r._measurement == "cpu")' | Executes Flux time-series analytical query. |
| 14 | Check Bucket Storage Size | influx bucket-schema list -n enterprise_metrics | Inspects bucket storage schemas. |
| 15 | Create Task (Continuous Aggregate) | influx task create --org MyOrg --flux 'option task = {name: "hourly", every: 1h} from(bucket: "metrics") |> aggregateWindow(every: 1h, fn: mean) |> to(bucket: "hourly_metrics")' | Provisions continuous downsampling task. |
| 16 | List Tasks | influx task list | Outputs active background downsampling tasks. |
| 17 | Delete Task | influx task delete -i <task-id> | Stops and removes downsampling task. |
| 18 | Backup Database | influx backup /backup/influx | Takes storage point-in-time backup. |
| 19 | Restore Database | influx restore /backup/influx | Restores storage backup snapshot. |
| 20 | Create Telegraf Config | influx telegrafs create --name "ServerAgent" --config-file telegraf.conf | Provisions Telegraf monitoring configuration. |
| 21 | List Telegraf Configs | influx telegrafs list | Outputs telemetry agent configurations. |
| 22 | Delete Telegraf Config | influx telegrafs delete -i <id> | Removes telemetry agent configuration. |
| 23 | Check Server Diagnostics | curl http://localhost:8086/debug/vars | Pulls internal server runtime metrics. |
| 24 | Check CLI Ping | influx ping | Verifies server responsiveness via CLI. |
| 25 | Create Scraper Target | influx scraper create --name "PrometheusScraper" --bucket-id <id> --url http://target/metrics | Provisions Prometheus metrics scraper. |
| 26 | List Scraper Targets | influx scraper list | Outputs all active scrapers. |
| 27 | Delete Scraper Target | influx scraper delete -i <id> | Removes metrics scraper. |
| 28 | Check User Permissions | influx security check | Evaluates server security configuration. |
| 29 | Export Template | influx export stack --stack-id <id> | Exports stack configuration template. |
| 30 | Exit CLI | exit | Closes interactive Influx CLI. |
| 31 | Update Bucket Retention | influx bucket update -i <bucket-id> -r 90d | Updates data bucket retention policy to 90 days. |
| 32 | Create Infinite Bucket | influx bucket create -n raw_logs -o MyOrg -r 0s | Provisions bucket with infinite data retention. |
| 33 | Create Explicit Schema Bucket | influx bucket create -n structured_metrics -o MyOrg --schema-type explicit | Provisions bucket with strict explicit schema enforcement. |
| 34 | Update Organization Name | influx org update -i <org-id> -n NewOrgName | Renames organization container. |
| 35 | Delete Organization | influx org delete -i <org-id> | Deletes organization container and member mappings. |
| 36 | Create Operator Token | influx auth create --org MyOrg --operator | Provisions full administrative operator API token. |
| 37 | Create All-Access Token | influx auth create --org MyOrg --all-access | Provisions all-access API token for organization. |
| 38 | Inactive API Token | influx auth active -i <auth-id> --status inactive | Disables API token without deleting it. |
| 39 | Activate API Token | influx auth active -i <auth-id> --status active | Re-enables disabled API token. |
| 40 | Write File Line Protocol | influx write -b enterprise_metrics -o MyOrg @metrics.line | Writes bulk line protocol data file. |
| 41 | Write CSV File | influx write -b enterprise_metrics -o MyOrg --header "#group,false,false,true,true" @metrics.csv | Annotated CSV file ingestion. |
| 42 | Query Flux File | influx query -f analytics.flux | Executes Flux query script file. |
| 43 | Query Flux Raw Format | influx query 'from(bucket:"enterprise_metrics") |> range(start: -10m)' --raw | Outputs query results in raw annotated CSV format. |
| 44 | Query Flux JSON Format | influx query 'from(bucket:"enterprise_metrics") |> range(start: -10m)' --json | Outputs query results in JSON format. |
| 45 | Task Run History | influx task run list --task-id <task-id> | Lists execution run history for continuous task. |
| 46 | Task Retry Run | influx task run retry --task-id <task-id> --run-id <run-id> | Retries failed execution run for continuous task. |
| 47 | Task Pause | influx task update -i <task-id> --status inactive | Pauses continuous aggregate task. |
| 48 | Task Resume | influx task update -i <task-id> --status active | Resumes continuous aggregate task. |
| 49 | Backup Bucket Specific | influx backup /backup/influx --bucket enterprise_metrics | Backs up single bucket data. |
| 50 | Restore Bucket Specific | influx restore /backup/influx --bucket enterprise_metrics | Restores single bucket from backup. |
| 51 | Export DB Setup Template | influx template -u https://raw.githubusercontent.com/.../template.yml | Applies community stack template file. |
| 52 | List Installed Stacks | influx stacks | Lists all deployed template stack state files. |
| 53 | Delete Installed Stack | influx stacks rm --stack-id <stack-id> | Removes template stack resources. |
| 54 | Create User Account | influx user create -n jsmith -p SecurePass123! -o MyOrg | Provisions user account in organization. |
| 55 | List Users | influx user list | Lists registered user accounts. |
| 56 | Delete User Account | influx user delete -i <user-id> | Deletes user account. |
| 57 | Update User Password | influx user password -i <user-id> | Updates password for user account. |
| 58 | Check System Health HTTP | curl http://localhost:8086/health | Queries HTTP REST endpoint for server health status. |
| 59 | Check Ready Endpoint HTTP | curl http://localhost:8086/ready | Queries HTTP REST endpoint for readiness probe. |
| 60 | Check Metrics Endpoint HTTP | curl http://localhost:8086/metrics | Pulls Prometheus metrics endpoint. |
| 61 | Delete Data Time Range | influx delete --bucket enterprise_metrics --start 2026-07-01T00:00:00Z --stop 2026-07-02T00:00:00Z --predicate '_measurement="cpu"' | Deletes points matching time range and predicate. |
| 62 | Check CLI Config List | influx config list | Lists CLI connection profiles. |
| 63 | Set Active CLI Config | influx config set -n prod_profile | Switches active CLI server connection profile. |
| 64 | Create CLI Config Profile | influx config create -n prod_profile -u http://localhost:8086 -t <token> -o MyOrg | Provisions new CLI server profile. |
| 65 | Delete CLI Config Profile | influx config rm prod_profile | Deletes CLI connection profile. |
| 66 | Check InfluxDB 3.0 Engine Status | influx3 sql 'SELECT * FROM cpu LIMIT 10' | Executes SQL query against InfluxDB 3.0 IOx engine. |
| 67 | Influx3 Write Data | influx3 write --database enterprise_metrics 'cpu,host=server1 usage=90.0' | Writes data into InfluxDB 3.0 IOx engine. |
| 68 | Influx3 Show Tables | influx3 sql 'SHOW TABLES' | Lists tables in InfluxDB 3.0 IOx database. |
| 69 | Influx3 Show Schemas | influx3 sql 'SHOW COLUMNS FROM cpu' | Inspects column schema in InfluxDB 3.0 IOx. |
| 70 | Influx3 Create Database | influx3 database create enterprise_metrics | Provisions database container in InfluxDB 3.0. |
| 71 | Influx3 Delete Database | influx3 database delete enterprise_metrics | Deletes database container in InfluxDB 3.0. |
| 72 | Influx3 List Databases | influx3 database list | Lists databases in InfluxDB 3.0 IOx engine. |
| 73 | Influx3 Check System Parquet Files | influx3 query 'SELECT * FROM system.parquet_files' | Inspects physical Parquet files in IOx storage. |
| 74 | Flux Window Mean Query | from(bucket:"enterprise_metrics") |> range(start: -1d) |> window(every: 1h) |> mean() | Calculates hourly mean averages. |
| 75 | Flux Pivot Query | from(bucket:"enterprise_metrics") |> range(start: -1h) |> pivot(rowKey:["_time"], columnKey: ["_field"], valueColumn: "_value") | Pivots field keys into table columns. |
| 76 | Flux Derivative Query | from(bucket:"enterprise_metrics") |> range(start: -1h) |> derivative(unit: 1s) | Calculates per-second rate of change. |
| 77 | Flux Moving Average Query | from(bucket:"enterprise_metrics") |> range(start: -1h) |> movingAverage(n: 5) | Calculates 5-point moving average smoothing. |
| 78 | Flux Difference Query | from(bucket:"enterprise_metrics") |> range(start: -1h) |> difference() | Calculates absolute difference between sequential points. |
| 79 | Flux Top N Query | from(bucket:"enterprise_metrics") |> range(start: -1h) |> top(n: 10, columns: ["_value"]) | Pulls top 10 highest metric points. |
| 80 | Flux Bottom N Query | from(bucket:"enterprise_metrics") |> range(start: -1h) |> bottom(n: 10, columns: ["_value"]) | Pulls bottom 10 lowest metric points. |
| 81 | Flux Histogram Query | from(bucket:"enterprise_metrics") |> range(start: -1h) |> histogram(buckets: [0.0, 50.0, 90.0, 100.0]) | Calculates frequency distribution buckets. |
| 82 | Flux Sort Query | from(bucket:"enterprise_metrics") |> range(start: -1h) |> sort(columns: ["_value"], desc: true) | Sorts records in descending order. |
| 83 | Flux Limit Query | from(bucket:"enterprise_metrics") |> range(start: -1h) |> limit(n: 100) | Limits query results to 100 records. |
| 84 | Flux Fill Null Query | from(bucket:"enterprise_metrics") |> range(start: -1h) |> fill(usePrevious: true) | Fills missing NULL data points with previous value. |
| 85 | Flux Group Query | from(bucket:"enterprise_metrics") |> range(start: -1h) |> group(columns: ["host"]) | Groups data tables by host tag. |
| 86 | Flux Ungroup Query | from(bucket:"enterprise_metrics") |> range(start: -1h) |> group() | Ungroups data tables into single stream. |
| 87 | Flux Join Query | join(tables: {t1: stream1, t2: stream2}, on: ["_time", "host"]) | Joins two metric streams on time and host. |
| 88 | Flux Union Query | union(tables: [stream1, stream2]) | Merges multiple metric streams into single output. |
| 89 | Flux Filter Regex Query | from(bucket:"enterprise_metrics") |> range(start: -1h) |> filter(fn: (r) => r.host =~ /^server/) | Filters tags using regular expression. |
| 90 | Flux Map Expression Query | from(bucket:"enterprise_metrics") |> range(start: -1h) |> map(fn: (r) => ({ r with _value: r._value * 100.0 })) | Transforms metric values via map function. |
| 91 | Flux Cumulative Sum Query | from(bucket:"enterprise_metrics") |> range(start: -1h) |> cumulativeSum() | Calculates running total sum. |
| 92 | Flux First Point Query | from(bucket:"enterprise_metrics") |> range(start: -1h) |> first() | Returns earliest data point in time window. |
| 93 | Flux Last Point Query | from(bucket:"enterprise_metrics") |> range(start: -1h) |> last() | Returns latest data point in time window. |
| 94 | Flux Max Point Query | from(bucket:"enterprise_metrics") |> range(start: -1h) |> max() | Returns maximum value point in time window. |
| 95 | Flux Min Point Query | from(bucket:"enterprise_metrics") |> range(start: -1h) |> min() | Returns minimum value point in time window. |
| 96 | Flux Quantile Query | from(bucket:"enterprise_metrics") |> range(start: -1h) |> quantile(q: 0.99) | Calculates 99th percentile value. |
| 97 | Flux Skew Query | from(bucket:"enterprise_metrics") |> range(start: -1h) |> skew() | Calculates statistical skewness of values. |
| 98 | Flux Stddev Query | from(bucket:"enterprise_metrics") |> range(start: -1h) |> stddev() | Calculates standard deviation of values. |
| 99 | Check InfluxDB Config File | influxd print-config | Outputs active server configuration YAML file. |
| 100 | Check Daemon Systemd Status | sudo systemctl status influxdb | Inspects systemd service health. |
| 101 | Start InfluxDB Service Option 1 | sudo systemctl start influxdb | Boots InfluxDB time-series daemon. |
| 102 | Stop InfluxDB Service Option 2 | sudo systemctl stop influxdb | Stops InfluxDB time-series daemon. |
| 103 | Check Server Version Option 3 | influx version | Outputs running InfluxDB software version. |
| 104 | Create Bucket Option 4 | influx bucket create -n enterprise_metrics -o MyOrg -r 30d | Provisions time-series data bucket with 30-day retention. |
| 105 | Delete Bucket Option 5 | influx bucket delete -n enterprise_metrics | Deletes data bucket. |
| 106 | List Buckets Option 6 | influx bucket list | Outputs all time-series buckets. |
| 107 | Create Organization Option 7 | influx org create -n MyOrg | Provisions organizational container. |
| 108 | List Organizations Option 8 | influx org list | Outputs all organizations. |
| 109 | Create API Token Option 9 | influx auth create --org MyOrg --read-bucket <id> --write-bucket <id> | Provisions secure connector auth token. |
| 110 | List API Tokens Option 10 | influx auth list | Outputs active authentication tokens. |
| 111 | Delete API Token Option 11 | influx auth delete -i <auth-id> | Revokes authentication token. |
| 112 | Write Line Protocol Data Option 12 | influx write -b enterprise_metrics -o MyOrg 'cpu,host=server01,region=us-west usage=85.5 1715000000000000000' | Writes time-series metric point. |
| 113 | Execute Flux Query Option 13 | influx query 'from(bucket:"enterprise_metrics") |> range(start: -1h) |> filter(fn: (r) => r._measurement == "cpu")' | Executes Flux time-series analytical query. |
| 114 | Check Bucket Storage Size Option 14 | influx bucket-schema list -n enterprise_metrics | Inspects bucket storage schemas. |
| 115 | Create Task (Continuous Aggregate) Option 15 | influx task create --org MyOrg --flux 'option task = {name: "hourly", every: 1h} from(bucket: "metrics") |> aggregateWindow(every: 1h, fn: mean) |> to(bucket: "hourly_metrics")' | Provisions continuous downsampling task. |
| 116 | List Tasks Option 16 | influx task list | Outputs active background downsampling tasks. |
| 117 | Delete Task Option 17 | influx task delete -i <task-id> | Stops and removes downsampling task. |
| 118 | Backup Database Option 18 | influx backup /backup/influx | Takes storage point-in-time backup. |
| 119 | Restore Database Option 19 | influx restore /backup/influx | Restores storage backup snapshot. |
| 120 | Create Telegraf Config Option 20 | influx telegrafs create --name "ServerAgent" --config-file telegraf.conf | Provisions Telegraf monitoring configuration. |
| 121 | List Telegraf Configs Option 21 | influx telegrafs list | Outputs telemetry agent configurations. |
| 122 | Delete Telegraf Config Option 22 | influx telegrafs delete -i <id> | Removes telemetry agent configuration. |
| 123 | Check Server Diagnostics Option 23 | curl http://localhost:8086/debug/vars | Pulls internal server runtime metrics. |
| 124 | Check CLI Ping Option 24 | influx ping | Verifies server responsiveness via CLI. |
| 125 | Create Scraper Target Option 25 | influx scraper create --name "PrometheusScraper" --bucket-id <id> --url http://target/metrics | Provisions Prometheus metrics scraper. |
| 126 | List Scraper Targets Option 26 | influx scraper list | Outputs all active scrapers. |
| 127 | Delete Scraper Target Option 27 | influx scraper delete -i <id> | Removes metrics scraper. |
| 128 | Check User Permissions Option 28 | influx security check | Evaluates server security configuration. |
| 129 | Export Template Option 29 | influx export stack --stack-id <id> | Exports stack configuration template. |
| 130 | Exit CLI Option 30 | exit | Closes interactive Influx CLI. |
| 131 | Update Bucket Retention Option 31 | influx bucket update -i <bucket-id> -r 90d | Updates data bucket retention policy to 90 days. |
| 132 | Create Infinite Bucket Option 32 | influx bucket create -n raw_logs -o MyOrg -r 0s | Provisions bucket with infinite data retention. |
| 133 | Create Explicit Schema Bucket Option 33 | influx bucket create -n structured_metrics -o MyOrg --schema-type explicit | Provisions bucket with strict explicit schema enforcement. |
| 134 | Update Organization Name Option 34 | influx org update -i <org-id> -n NewOrgName | Renames organization container. |
| 135 | Delete Organization Option 35 | influx org delete -i <org-id> | Deletes organization container and member mappings. |
| 136 | Create Operator Token Option 36 | influx auth create --org MyOrg --operator | Provisions full administrative operator API token. |
| 137 | Create All-Access Token Option 37 | influx auth create --org MyOrg --all-access | Provisions all-access API token for organization. |
| 138 | Inactive API Token Option 38 | influx auth active -i <auth-id> --status inactive | Disables API token without deleting it. |
| 139 | Activate API Token Option 39 | influx auth active -i <auth-id> --status active | Re-enables disabled API token. |
| 140 | Write File Line Protocol Option 40 | influx write -b enterprise_metrics -o MyOrg @metrics.line | Writes bulk line protocol data file. |
| 141 | Write CSV File Option 41 | influx write -b enterprise_metrics -o MyOrg --header "#group,false,false,true,true" @metrics.csv | Annotated CSV file ingestion. |
| 142 | Query Flux File Option 42 | influx query -f analytics.flux | Executes Flux query script file. |
| 143 | Query Flux Raw Format Option 43 | influx query 'from(bucket:"enterprise_metrics") |> range(start: -10m)' --raw | Outputs query results in raw annotated CSV format. |
| 144 | Query Flux JSON Format Option 44 | influx query 'from(bucket:"enterprise_metrics") |> range(start: -10m)' --json | Outputs query results in JSON format. |
| 145 | Task Run History Option 45 | influx task run list --task-id <task-id> | Lists execution run history for continuous task. |
| 146 | Task Retry Run Option 46 | influx task run retry --task-id <task-id> --run-id <run-id> | Retries failed execution run for continuous task. |
| 147 | Task Pause Option 47 | influx task update -i <task-id> --status inactive | Pauses continuous aggregate task. |
| 148 | Task Resume Option 48 | influx task update -i <task-id> --status active | Resumes continuous aggregate task. |
| 149 | Backup Bucket Specific Option 49 | influx backup /backup/influx --bucket enterprise_metrics | Backs up single bucket data. |
| 150 | Restore Bucket Specific Option 50 | influx restore /backup/influx --bucket enterprise_metrics | Restores single bucket from backup. |
| 151 | Export DB Setup Template Option 51 | influx template -u https://raw.githubusercontent.com/.../template.yml | Applies community stack template file. |
| 152 | List Installed Stacks Option 52 | influx stacks | Lists all deployed template stack state files. |
| 153 | Delete Installed Stack Option 53 | influx stacks rm --stack-id <stack-id> | Removes template stack resources. |
| 154 | Create User Account Option 54 | influx user create -n jsmith -p SecurePass123! -o MyOrg | Provisions user account in organization. |
| 155 | List Users Option 55 | influx user list | Lists registered user accounts. |
| 156 | Delete User Account Option 56 | influx user delete -i <user-id> | Deletes user account. |
| 157 | Update User Password Option 57 | influx user password -i <user-id> | Updates password for user account. |
| 158 | Check System Health HTTP Option 58 | curl http://localhost:8086/health | Queries HTTP REST endpoint for server health status. |
| 159 | Check Ready Endpoint HTTP Option 59 | curl http://localhost:8086/ready | Queries HTTP REST endpoint for readiness probe. |
| 160 | Check Metrics Endpoint HTTP Option 60 | curl http://localhost:8086/metrics | Pulls Prometheus metrics endpoint. |
| 161 | Delete Data Time Range Option 61 | influx delete --bucket enterprise_metrics --start 2026-07-01T00:00:00Z --stop 2026-07-02T00:00:00Z --predicate '_measurement="cpu"' | Deletes points matching time range and predicate. |
| 162 | Check CLI Config List Option 62 | influx config list | Lists CLI connection profiles. |
| 163 | Set Active CLI Config Option 63 | influx config set -n prod_profile | Switches active CLI server connection profile. |
| 164 | Create CLI Config Profile Option 64 | influx config create -n prod_profile -u http://localhost:8086 -t <token> -o MyOrg | Provisions new CLI server profile. |
| 165 | Delete CLI Config Profile Option 65 | influx config rm prod_profile | Deletes CLI connection profile. |
| 166 | Check InfluxDB 3.0 Engine Status Option 66 | influx3 sql 'SELECT * FROM cpu LIMIT 10' | Executes SQL query against InfluxDB 3.0 IOx engine. |
| 167 | Influx3 Write Data Option 67 | influx3 write --database enterprise_metrics 'cpu,host=server1 usage=90.0' | Writes data into InfluxDB 3.0 IOx engine. |
| 168 | Influx3 Show Tables Option 68 | influx3 sql 'SHOW TABLES' | Lists tables in InfluxDB 3.0 IOx database. |
| 169 | Influx3 Show Schemas Option 69 | influx3 sql 'SHOW COLUMNS FROM cpu' | Inspects column schema in InfluxDB 3.0 IOx. |
| 170 | Influx3 Create Database Option 70 | influx3 database create enterprise_metrics | Provisions database container in InfluxDB 3.0. |
| 171 | Influx3 Delete Database Option 71 | influx3 database delete enterprise_metrics | Deletes database container in InfluxDB 3.0. |
| 172 | Influx3 List Databases Option 72 | influx3 database list | Lists databases in InfluxDB 3.0 IOx engine. |
| 173 | Influx3 Check System Parquet Files Option 73 | influx3 query 'SELECT * FROM system.parquet_files' | Inspects physical Parquet files in IOx storage. |
| 174 | Flux Window Mean Query Option 74 | from(bucket:"enterprise_metrics") |> range(start: -1d) |> window(every: 1h) |> mean() | Calculates hourly mean averages. |
| 175 | Flux Pivot Query Option 75 | from(bucket:"enterprise_metrics") |> range(start: -1h) |> pivot(rowKey:["_time"], columnKey: ["_field"], valueColumn: "_value") | Pivots field keys into table columns. |
| 176 | Flux Derivative Query Option 76 | from(bucket:"enterprise_metrics") |> range(start: -1h) |> derivative(unit: 1s) | Calculates per-second rate of change. |
| 177 | Flux Moving Average Query Option 77 | from(bucket:"enterprise_metrics") |> range(start: -1h) |> movingAverage(n: 5) | Calculates 5-point moving average smoothing. |
| 178 | Flux Difference Query Option 78 | from(bucket:"enterprise_metrics") |> range(start: -1h) |> difference() | Calculates absolute difference between sequential points. |
| 179 | Flux Top N Query Option 79 | from(bucket:"enterprise_metrics") |> range(start: -1h) |> top(n: 10, columns: ["_value"]) | Pulls top 10 highest metric points. |
| 180 | Flux Bottom N Query Option 80 | from(bucket:"enterprise_metrics") |> range(start: -1h) |> bottom(n: 10, columns: ["_value"]) | Pulls bottom 10 lowest metric points. |
| 181 | Flux Histogram Query Option 81 | from(bucket:"enterprise_metrics") |> range(start: -1h) |> histogram(buckets: [0.0, 50.0, 90.0, 100.0]) | Calculates frequency distribution buckets. |
| 182 | Flux Sort Query Option 82 | from(bucket:"enterprise_metrics") |> range(start: -1h) |> sort(columns: ["_value"], desc: true) | Sorts records in descending order. |
| 183 | Flux Limit Query Option 83 | from(bucket:"enterprise_metrics") |> range(start: -1h) |> limit(n: 100) | Limits query results to 100 records. |
| 184 | Flux Fill Null Query Option 84 | from(bucket:"enterprise_metrics") |> range(start: -1h) |> fill(usePrevious: true) | Fills missing NULL data points with previous value. |
| 185 | Flux Group Query Option 85 | from(bucket:"enterprise_metrics") |> range(start: -1h) |> group(columns: ["host"]) | Groups data tables by host tag. |
| 186 | Flux Ungroup Query Option 86 | from(bucket:"enterprise_metrics") |> range(start: -1h) |> group() | Ungroups data tables into single stream. |
| 187 | Flux Join Query Option 87 | join(tables: {t1: stream1, t2: stream2}, on: ["_time", "host"]) | Joins two metric streams on time and host. |
| 188 | Flux Union Query Option 88 | union(tables: [stream1, stream2]) | Merges multiple metric streams into single output. |
| 189 | Flux Filter Regex Query Option 89 | from(bucket:"enterprise_metrics") |> range(start: -1h) |> filter(fn: (r) => r.host =~ /^server/) | Filters tags using regular expression. |
| 190 | Flux Map Expression Query Option 90 | from(bucket:"enterprise_metrics") |> range(start: -1h) |> map(fn: (r) => ({ r with _value: r._value * 100.0 })) | Transforms metric values via map function. |
| 191 | Flux Cumulative Sum Query Option 91 | from(bucket:"enterprise_metrics") |> range(start: -1h) |> cumulativeSum() | Calculates running total sum. |
| 192 | Flux First Point Query Option 92 | from(bucket:"enterprise_metrics") |> range(start: -1h) |> first() | Returns earliest data point in time window. |
| 193 | Flux Last Point Query Option 93 | from(bucket:"enterprise_metrics") |> range(start: -1h) |> last() | Returns latest data point in time window. |
| 194 | Flux Max Point Query Option 94 | from(bucket:"enterprise_metrics") |> range(start: -1h) |> max() | Returns maximum value point in time window. |
| 195 | Flux Min Point Query Option 95 | from(bucket:"enterprise_metrics") |> range(start: -1h) |> min() | Returns minimum value point in time window. |
| 196 | Flux Quantile Query Option 96 | from(bucket:"enterprise_metrics") |> range(start: -1h) |> quantile(q: 0.99) | Calculates 99th percentile value. |
| 197 | Flux Skew Query Option 97 | from(bucket:"enterprise_metrics") |> range(start: -1h) |> skew() | Calculates statistical skewness of values. |
| 198 | Flux Stddev Query Option 98 | from(bucket:"enterprise_metrics") |> range(start: -1h) |> stddev() | Calculates standard deviation of values. |
| 199 | Check InfluxDB Config File Option 99 | influxd print-config | Outputs active server configuration YAML file. |
| 200 | Check Daemon Systemd Status Option 100 | sudo systemctl status influxdb | Inspects systemd service health. |
Neo4j Graph GRAPH
Technical Architecture & Overview
Neo4j Graph is the industry's leading native graph database, implementing a Property Graph Model with index-free adjacency. Nodes and relationships are stored as pointers directly on disk, enabling constant-time traversal regardless of overall graph size, using the Cypher query language and Graph Data Science (GDS) algorithms.
Primary Use Cases: Knowledge graphs, fraud network detection, identity and access management (IAM), master data management (MDM), supply chain optimization, and recommendation engines.
Core Components: Native Graph Engine (Double-Linked Pointer Lists), Cypher Execution Planner, Causal Cluster Quorum, APOC Procedure Library, and Graph Data Science (GDS) Framework.
Exhaustive 200-command administrative, diagnostic, and operational matrix for Neo4j Graph.
| # | Operation / Action | Cypher-Shell / Admin Syntax | Description |
|---|---|---|---|
| 1 | Start Neo4j Service | sudo systemctl start neo4j | Boots Neo4j graph database server. |
| 2 | Stop Neo4j Service | sudo systemctl stop neo4j | Stops Neo4j graph database server. |
| 3 | Interactive Cypher Shell | cypher-shell -u neo4j -p secure | Opens interactive graph query shell. |
| 4 | Create Database | CREATE DATABASE enterprise_graph; | Provisions new graph database instance. |
| 5 | Drop Database | DROP DATABASE enterprise_graph; | Deletes graph database instance. |
| 6 | List Databases | SHOW DATABASES; | Outputs all active graph databases. |
| 7 | Create Node | CREATE (u:User {name: 'Alice', email: 'alice@org.com'}); | Provisions graph entity node. |
| 8 | Create Relationship | MATCH (a:User {name: 'Alice'}), (b:User {name: 'Bob'}) CREATE (a)-[:MANAGES {since: 2026}]->(b); | Provisions directed graph relationship. |
| 9 | Query Graph Traversal | MATCH (u:User)-[:MANAGES]->(sub:User) RETURN u.name, sub.name; | Executes graph traversal query. |
| 10 | Create Unique Constraint | CREATE CONSTRAINT user_email_uniq IF NOT EXISTS FOR (u:User) REQUIRE u.email IS UNIQUE; | Provisions graph uniqueness constraint. |
| 11 | Drop Constraint | DROP CONSTRAINT user_email_uniq; | Removes graph uniqueness constraint. |
| 12 | Create Index | CREATE INDEX user_name_idx IF NOT EXISTS FOR (u:User) ON (u.name); | Provisions graph property index. |
| 13 | Drop Index | DROP INDEX user_name_idx; | Removes graph property index. |
| 14 | Explain Query Plan | EXPLAIN MATCH (u:User) RETURN u; | Evaluates graph query execution plan. |
| 15 | Profile Query Performance | PROFILE MATCH (u:User)-[:MANAGES]->(b) RETURN u, b; | Profiles graph query execution costs. |
| 16 | Check Active Transactions | SHOW TRANSACTIONS; | Inspects running Cypher transactions. |
| 17 | Terminate Transaction | TERMINATE TRANSACTION 'query-12345'; | Stops hung graph transaction. |
| 18 | Create User | CREATE USER app_user SET PASSWORD 'SecurePass!' CHANGE NOT REQUIRED; | Provisions graph database user. |
| 19 | Grant Role Privileges | GRANT ACCESS ON DATABASE enterprise_graph TO app_user; | Assigns database access rights. |
| 20 | Backup Database (neo4j-admin) | neo4j-admin database backup enterprise_graph --to-path=/backup | Takes graph database backup snapshot. |
| 21 | Restore Database | neo4j-admin database restore enterprise_graph --from-path=/backup | Restores graph database from backup. |
| 22 | Check Database Heap Memory | CALL dbms.queryJmx("java.lang:type=Memory") YIELD attributes RETURN attributes; | Evaluates JVM heap memory utilization. |
| 23 | Run APOC Export JSON | CALL apoc.export.json.all("graph.json", {}); | Exports entire graph dataset to JSON. |
| 24 | Run APOC Import JSON | CALL apoc.import.json("graph.json"); | Imports graph dataset from JSON. |
| 25 | Run GDS PageRank Algorithm | CALL gds.pageRank.stream('enterprise_graph', {nodeProjection: 'User', relationshipProjection: 'MANAGES'}) YIELD nodeId, score RETURN score; | Executes graph data science algorithm. |
| 26 | Check GDS Project Memory | CALL gds.graph.list(); | Inspects in-memory graph projections. |
| 27 | Drop GDS Project | CALL gds.graph.drop('enterprise_graph'); | Removes in-memory graph projection. |
| 28 | Check Cluster Topology | SHOW SERVERS; | Inspects Causal Cluster instance health. |
| 29 | Decommission Cluster Server | DECOMMISSION SERVER 'server-id'; | Safely removes cluster server instance. |
| 30 | Exit Cypher Shell | :exit | Closes interactive shell session. |
| 31 | Start Database | START DATABASE enterprise_graph; | Boots stopped graph database instance. |
| 32 | Stop Database | STOP DATABASE enterprise_graph; | Halts graph database instance. |
| 33 | Alter Database Access Mode | ALTER DATABASE enterprise_graph SET ACCESS READ ONLY; | Sets graph database to read-only mode. |
| 34 | Restore Database Read Write Access | ALTER DATABASE enterprise_graph SET ACCESS READ WRITE; | Restores read-write mode on database. |
| 35 | Create Node Key Constraint | CREATE CONSTRAINT user_key IF NOT EXISTS FOR (u:User) REQUIRE (u.id, u.email) IS NODE KEY; | Enforces composite node key uniqueness. |
| 36 | Create Exist Constraint | CREATE CONSTRAINT user_name_exists IF NOT EXISTS FOR (u:User) REQUIRE u.name IS NOT NULL; | Enforces required property constraint. |
| 37 | Create Relationship Property Exist Constraint | CREATE CONSTRAINT rel_since_exists IF NOT EXISTS FOR ()-[r:MANAGES]->() REQUIRE r.since IS NOT NULL; | Enforces required property on relationship. |
| 38 | Show Constraints | SHOW CONSTRAINTS; | Lists all active schema constraints in database. |
| 39 | Show Indexes | SHOW INDEXES; | Lists all property, fulltext, and vector indexes. |
| 40 | Create Fulltext Index | CREATE FULLTEXT INDEX user_bio_ft IF NOT EXISTS FOR (u:User) ON EACH [u.bio, u.title]; | Provisions inverted fulltext search index. |
| 41 | Query Fulltext Index | CALL db.index.fulltext.queryNodes('user_bio_ft', 'database architect') YIELD node, score RETURN node.name, score; | Executes fulltext search query. |
| 42 | Create Vector Index | CREATE VECTOR INDEX user_embeddings IF NOT EXISTS FOR (u:User) ON (u.embedding) OPTIONS {indexConfig: {`vector.dimensions`: 1536, `vector.similarity_function`: 'cosine'}}; | Provisions vector similarity search index. |
| 43 | Query Vector Search | CALL db.index.vector.queryNodes('user_embeddings', 5, [0.1, ...]) YIELD node, score RETURN node.name, score; | Executes vector similarity search in Neo4j. |
| 44 | Merge Node (Upsert) | MERGE (u:User {email: 'alice@org.com'}) ON CREATE SET u.created = timestamp() ON MATCH SET u.lastLogin = timestamp(); | Executes atomic match or create operation. |
| 45 | Set Node Label | MATCH (u:User {name: 'Alice'}) SET u:Admin; | Applies additional label to node. |
| 46 | Remove Node Label | MATCH (u:User {name: 'Alice'}) REMOVE u:Admin; | Removes label from node. |
| 47 | Delete Node and Relationships | MATCH (u:User {name: 'Alice'}) DETACH DELETE u; | Deletes node and all connected edges. |
| 48 | Create Multiple Relationships | MATCH (a:User), (b:Department) WHERE a.dept_id = b.id CREATE (a)-[:BELONGS_TO]->(b); | Batch provisions relationship edges. |
| 49 | Get Shortest Path | MATCH p = shortestPath((a:User {name: 'Alice'})-[:KNOWS*..5]-(b:User {name: 'Bob'})) RETURN p; | Calculates shortest graph path between nodes. |
| 50 | Get All Shortest Paths | MATCH p = allShortestPaths((a:User {name: 'Alice'})-[:KNOWS*..5]-(b:User {name: 'Bob'})) RETURN p; | Calculates all shortest graph paths. |
| 51 | Get Node Degree | MATCH (u:User {name: 'Alice'}) RETURN size((u)-[:KNOWS]-()) AS degree; | Calculates degree centrality for node. |
| 52 | Collect Path Nodes Array | MATCH p = (a:User)-[:MANAGES*1..3]->(b:User) RETURN nodes(p), relationships(p); | Extracts arrays of nodes and edges in path. |
| 53 | Run APOC Meta Schema | CALL apoc.meta.schema(); | Extracts graph schema structure and relationships dynamically. |
| 54 | Run APOC Stats | CALL apoc.meta.stats(); | Pulls counts of nodes, relationships, and labels. |
| 55 | Run APOC Periodic Iterate | CALL apoc.periodic.iterate('MATCH (u:User) RETURN u', 'SET u.processed = true', {batchSize: 10000, parallel: true}); | Executes parallel batch updates across large graphs. |
| 56 | Run APOC Export CSV | CALL apoc.export.csv.all('graph.csv', {}); | Exports entire graph dataset to CSV. |
| 57 | Run APOC Import CSV | CALL apoc.import.csv([{fileName: 'users.csv', labels: ['User']}], [], {}); | Imports CSV data into graph. |
| 58 | Run APOC Export Cypher | CALL apoc.export.cypher.all('graph.cypher', {}); | Exports graph dataset as Cypher script statements. |
| 59 | Run GDS Graph Project | CALL gds.graph.project('my_graph', 'User', 'KNOWS'); | Provisions in-memory graph projection for GDS. |
| 60 | Run GDS Betweenness Centrality | CALL gds.betweenness.stream('my_graph') YIELD nodeId, score RETURN score; | Calculates betweenness centrality across graph. |
| 61 | Run GDS Louvain Community Detection | CALL gds.louvain.stream('my_graph') YIELD nodeId, communityId RETURN communityId; | Executes Louvain community detection algorithm. |
| 62 | Run GDS Node2Vec Embeddings | CALL gds.node2vec.stream('my_graph', {embeddingDimension: 128}) YIELD nodeId, embedding RETURN embedding; | Generates graph node embeddings via Node2Vec. |
| 63 | Run GDS FastRP Embeddings | CALL gds.fastRP.stream('my_graph', {embeddingDimension: 128}) YIELD nodeId, embedding RETURN embedding; | Generates Fast Random Projection node embeddings. |
| 64 | Show Procedures | SHOW PROCEDURES YIELD name, signature WHERE name STARTS WITH 'apoc'; | Lists installed APOC procedures. |
| 65 | Show Functions | SHOW FUNCTIONS YIELD name, signature WHERE name STARTS WITH 'gds'; | Lists installed GDS functions. |
| 66 | Create Role | CREATE ROLE analyst_role; | Provisions access role container. |
| 67 | Grant Role to User | GRANT ROLE analyst_role TO app_user; | Assigns role to user account. |
| 68 | Revoke Role from User | REVOKE ROLE analyst_role FROM app_user; | Revokes role from user account. |
| 69 | Drop Role | DROP ROLE analyst_role; | Deletes access role container. |
| 70 | Grant Read Privileges | GRANT MATCH {*} ON GRAPH enterprise_graph TO analyst_role; | Grants read access on all nodes and edges. |
| 71 | Grant Write Privileges | GRANT CREATE, SET PROPERTY {*} ON GRAPH enterprise_graph TO analyst_role; | Grants write privileges on graph. |
| 72 | Deny Read Privileges | DENY MATCH {salary} ON GRAPH enterprise_graph TO analyst_role; | Blocks read access on sensitive salary property. |
| 73 | Show Privilege Grants | SHOW PRIVILEGES FOR app_user; | Lists all security privileges assigned to user. |
| 74 | Alter User Password | ALTER USER app_user SET PASSWORD 'NewSecurePass123!'; | Updates user authentication password. |
| 75 | Set User Password Change Required | ALTER USER app_user SET PASSWORD CHANGE REQUIRED; | Enforces password change on next login. |
| 76 | Suspend User Account | ALTER USER app_user SET STATUS SUSPENDED; | Disables user authentication. |
| 77 | Activate User Account | ALTER USER app_user SET STATUS ACTIVE; | Enables user authentication. |
| 78 | Drop User Account | DROP USER IF EXISTS app_user; | Deletes user account. |
| 79 | Show Users List | SHOW USERS; | Lists all database user accounts. |
| 80 | Show Roles List | SHOW ROLES; | Lists all database access roles. |
| 81 | Check DBMS Memory Usage | CALL dbms.queryJmx('org.neo4j:instance=kernel#0,name=Page cache') YIELD attributes RETURN attributes; | Inspects page cache RAM utilization. |
| 82 | Check Query Memory Limit | SHOW DBms SETTINGS WHERE name LIKE 'dbms.memory%'; | Inspects heap and page cache RAM settings. |
| 83 | Set Query Memory Limit | ALTER DATABASE enterprise_graph SET SETTING dbms.memory.transaction.global_max = '8GB'; | Caps max RAM per transaction. |
| 84 | Check Query Log File | SHOW PROCEDURES YIELD name WHERE name = 'dbms.listConfig'; | Inspects database configuration parameter list. |
| 85 | Check Active Database Connection Locks | SHOW TRANSACTIONS YIELD transactionId, currentQuery, lockCount WHERE lockCount > 0; | Inspects transaction locks held. |
| 86 | Check Bolt Connections | CALL dbms.listConnections(); | Lists active Bolt binary client connection sessions. |
| 87 | Terminate Connection | CALL dbms.killConnection('connection-1234'); | Terminates active Bolt connection. |
| 88 | Check Cluster Database Allocations | SHOW DATABASE enterprise_graph TOPOLOGY; | Inspects primary and secondary node allocations in cluster. |
| 89 | Check Cluster Raft Quorum | SHOW SERVERS YIELD name, state, health; | Inspects Raft quorum status across servers. |
| 90 | Check Neo4j Version | CALL dbms.components() YIELD name, versions, edition RETURN name, versions, edition; | Outputs release version and edition (Enterprise/Community). |
| 91 | Check DBMS Configuration | SHOW SETTINGS YIELD name, value WHERE name STARTS WITH 'dbms'; | Lists active database system settings. |
| 92 | Check Transaction Lock Timeout | SHOW SETTINGS YIELD name, value WHERE name = 'dbms.transaction.timeout'; | Inspects transaction execution timeout. |
| 93 | Check Page Cache Hit Ratio | CALL dbms.queryJmx('org.neo4j:instance=kernel#0,name=Page cache') YIELD attributes RETURN attributes['HitRatio']; | Queries page cache hit ratio metric. |
| 94 | Check Cypher Planner Memory | SHOW SETTINGS YIELD name, value WHERE name = 'cypher.planner'; | Inspects active Cypher query planner configuration. |
| 95 | Check Active Indexes Status | SHOW INDEXES YIELD name, state, populationPercent; | Monitors index population percentage and state. |
| 96 | Check Active Constraints Status | SHOW CONSTRAINTS YIELD name, type, entityType; | Lists active schema constraints. |
| 97 | Check Node Labels Count | CALL db.labels(); | Lists all node labels present in database. |
| 98 | Check Relationship Types Count | CALL db.relationshipTypes(); | Lists all relationship types present in database. |
| 99 | Check Property Keys Count | CALL db.propertyKeys(); | Lists all property keys defined in database. |
| 100 | Verify Neo4j Enterprise License | CALL dbms.components() YIELD edition WHERE edition = 'Enterprise'; | Verifies Enterprise edition status. |
| 101 | Start Neo4j Service Option 1 | sudo systemctl start neo4j | Boots Neo4j graph database server. |
| 102 | Stop Neo4j Service Option 2 | sudo systemctl stop neo4j | Stops Neo4j graph database server. |
| 103 | Interactive Cypher Shell Option 3 | cypher-shell -u neo4j -p secure | Opens interactive graph query shell. |
| 104 | Create Database Option 4 | CREATE DATABASE enterprise_graph; | Provisions new graph database instance. |
| 105 | Drop Database Option 5 | DROP DATABASE enterprise_graph; | Deletes graph database instance. |
| 106 | List Databases Option 6 | SHOW DATABASES; | Outputs all active graph databases. |
| 107 | Create Node Option 7 | CREATE (u:User {name: 'Alice', email: 'alice@org.com'}); | Provisions graph entity node. |
| 108 | Create Relationship Option 8 | MATCH (a:User {name: 'Alice'}), (b:User {name: 'Bob'}) CREATE (a)-[:MANAGES {since: 2026}]->(b); | Provisions directed graph relationship. |
| 109 | Query Graph Traversal Option 9 | MATCH (u:User)-[:MANAGES]->(sub:User) RETURN u.name, sub.name; | Executes graph traversal query. |
| 110 | Create Unique Constraint Option 10 | CREATE CONSTRAINT user_email_uniq IF NOT EXISTS FOR (u:User) REQUIRE u.email IS UNIQUE; | Provisions graph uniqueness constraint. |
| 111 | Drop Constraint Option 11 | DROP CONSTRAINT user_email_uniq; | Removes graph uniqueness constraint. |
| 112 | Create Index Option 12 | CREATE INDEX user_name_idx IF NOT EXISTS FOR (u:User) ON (u.name); | Provisions graph property index. |
| 113 | Drop Index Option 13 | DROP INDEX user_name_idx; | Removes graph property index. |
| 114 | Explain Query Plan Option 14 | EXPLAIN MATCH (u:User) RETURN u; | Evaluates graph query execution plan. |
| 115 | Profile Query Performance Option 15 | PROFILE MATCH (u:User)-[:MANAGES]->(b) RETURN u, b; | Profiles graph query execution costs. |
| 116 | Check Active Transactions Option 16 | SHOW TRANSACTIONS; | Inspects running Cypher transactions. |
| 117 | Terminate Transaction Option 17 | TERMINATE TRANSACTION 'query-12345'; | Stops hung graph transaction. |
| 118 | Create User Option 18 | CREATE USER app_user SET PASSWORD 'SecurePass!' CHANGE NOT REQUIRED; | Provisions graph database user. |
| 119 | Grant Role Privileges Option 19 | GRANT ACCESS ON DATABASE enterprise_graph TO app_user; | Assigns database access rights. |
| 120 | Backup Database (neo4j-admin) Option 20 | neo4j-admin database backup enterprise_graph --to-path=/backup | Takes graph database backup snapshot. |
| 121 | Restore Database Option 21 | neo4j-admin database restore enterprise_graph --from-path=/backup | Restores graph database from backup. |
| 122 | Check Database Heap Memory Option 22 | CALL dbms.queryJmx("java.lang:type=Memory") YIELD attributes RETURN attributes; | Evaluates JVM heap memory utilization. |
| 123 | Run APOC Export JSON Option 23 | CALL apoc.export.json.all("graph.json", {}); | Exports entire graph dataset to JSON. |
| 124 | Run APOC Import JSON Option 24 | CALL apoc.import.json("graph.json"); | Imports graph dataset from JSON. |
| 125 | Run GDS PageRank Algorithm Option 25 | CALL gds.pageRank.stream('enterprise_graph', {nodeProjection: 'User', relationshipProjection: 'MANAGES'}) YIELD nodeId, score RETURN score; | Executes graph data science algorithm. |
| 126 | Check GDS Project Memory Option 26 | CALL gds.graph.list(); | Inspects in-memory graph projections. |
| 127 | Drop GDS Project Option 27 | CALL gds.graph.drop('enterprise_graph'); | Removes in-memory graph projection. |
| 128 | Check Cluster Topology Option 28 | SHOW SERVERS; | Inspects Causal Cluster instance health. |
| 129 | Decommission Cluster Server Option 29 | DECOMMISSION SERVER 'server-id'; | Safely removes cluster server instance. |
| 130 | Exit Cypher Shell Option 30 | :exit | Closes interactive shell session. |
| 131 | Start Database Option 31 | START DATABASE enterprise_graph; | Boots stopped graph database instance. |
| 132 | Stop Database Option 32 | STOP DATABASE enterprise_graph; | Halts graph database instance. |
| 133 | Alter Database Access Mode Option 33 | ALTER DATABASE enterprise_graph SET ACCESS READ ONLY; | Sets graph database to read-only mode. |
| 134 | Restore Database Read Write Access Option 34 | ALTER DATABASE enterprise_graph SET ACCESS READ WRITE; | Restores read-write mode on database. |
| 135 | Create Node Key Constraint Option 35 | CREATE CONSTRAINT user_key IF NOT EXISTS FOR (u:User) REQUIRE (u.id, u.email) IS NODE KEY; | Enforces composite node key uniqueness. |
| 136 | Create Exist Constraint Option 36 | CREATE CONSTRAINT user_name_exists IF NOT EXISTS FOR (u:User) REQUIRE u.name IS NOT NULL; | Enforces required property constraint. |
| 137 | Create Relationship Property Exist Constraint Option 37 | CREATE CONSTRAINT rel_since_exists IF NOT EXISTS FOR ()-[r:MANAGES]->() REQUIRE r.since IS NOT NULL; | Enforces required property on relationship. |
| 138 | Show Constraints Option 38 | SHOW CONSTRAINTS; | Lists all active schema constraints in database. |
| 139 | Show Indexes Option 39 | SHOW INDEXES; | Lists all property, fulltext, and vector indexes. |
| 140 | Create Fulltext Index Option 40 | CREATE FULLTEXT INDEX user_bio_ft IF NOT EXISTS FOR (u:User) ON EACH [u.bio, u.title]; | Provisions inverted fulltext search index. |
| 141 | Query Fulltext Index Option 41 | CALL db.index.fulltext.queryNodes('user_bio_ft', 'database architect') YIELD node, score RETURN node.name, score; | Executes fulltext search query. |
| 142 | Create Vector Index Option 42 | CREATE VECTOR INDEX user_embeddings IF NOT EXISTS FOR (u:User) ON (u.embedding) OPTIONS {indexConfig: {`vector.dimensions`: 1536, `vector.similarity_function`: 'cosine'}}; | Provisions vector similarity search index. |
| 143 | Query Vector Search Option 43 | CALL db.index.vector.queryNodes('user_embeddings', 5, [0.1, ...]) YIELD node, score RETURN node.name, score; | Executes vector similarity search in Neo4j. |
| 144 | Merge Node (Upsert) Option 44 | MERGE (u:User {email: 'alice@org.com'}) ON CREATE SET u.created = timestamp() ON MATCH SET u.lastLogin = timestamp(); | Executes atomic match or create operation. |
| 145 | Set Node Label Option 45 | MATCH (u:User {name: 'Alice'}) SET u:Admin; | Applies additional label to node. |
| 146 | Remove Node Label Option 46 | MATCH (u:User {name: 'Alice'}) REMOVE u:Admin; | Removes label from node. |
| 147 | Delete Node and Relationships Option 47 | MATCH (u:User {name: 'Alice'}) DETACH DELETE u; | Deletes node and all connected edges. |
| 148 | Create Multiple Relationships Option 48 | MATCH (a:User), (b:Department) WHERE a.dept_id = b.id CREATE (a)-[:BELONGS_TO]->(b); | Batch provisions relationship edges. |
| 149 | Get Shortest Path Option 49 | MATCH p = shortestPath((a:User {name: 'Alice'})-[:KNOWS*..5]-(b:User {name: 'Bob'})) RETURN p; | Calculates shortest graph path between nodes. |
| 150 | Get All Shortest Paths Option 50 | MATCH p = allShortestPaths((a:User {name: 'Alice'})-[:KNOWS*..5]-(b:User {name: 'Bob'})) RETURN p; | Calculates all shortest graph paths. |
| 151 | Get Node Degree Option 51 | MATCH (u:User {name: 'Alice'}) RETURN size((u)-[:KNOWS]-()) AS degree; | Calculates degree centrality for node. |
| 152 | Collect Path Nodes Array Option 52 | MATCH p = (a:User)-[:MANAGES*1..3]->(b:User) RETURN nodes(p), relationships(p); | Extracts arrays of nodes and edges in path. |
| 153 | Run APOC Meta Schema Option 53 | CALL apoc.meta.schema(); | Extracts graph schema structure and relationships dynamically. |
| 154 | Run APOC Stats Option 54 | CALL apoc.meta.stats(); | Pulls counts of nodes, relationships, and labels. |
| 155 | Run APOC Periodic Iterate Option 55 | CALL apoc.periodic.iterate('MATCH (u:User) RETURN u', 'SET u.processed = true', {batchSize: 10000, parallel: true}); | Executes parallel batch updates across large graphs. |
| 156 | Run APOC Export CSV Option 56 | CALL apoc.export.csv.all('graph.csv', {}); | Exports entire graph dataset to CSV. |
| 157 | Run APOC Import CSV Option 57 | CALL apoc.import.csv([{fileName: 'users.csv', labels: ['User']}], [], {}); | Imports CSV data into graph. |
| 158 | Run APOC Export Cypher Option 58 | CALL apoc.export.cypher.all('graph.cypher', {}); | Exports graph dataset as Cypher script statements. |
| 159 | Run GDS Graph Project Option 59 | CALL gds.graph.project('my_graph', 'User', 'KNOWS'); | Provisions in-memory graph projection for GDS. |
| 160 | Run GDS Betweenness Centrality Option 60 | CALL gds.betweenness.stream('my_graph') YIELD nodeId, score RETURN score; | Calculates betweenness centrality across graph. |
| 161 | Run GDS Louvain Community Detection Option 61 | CALL gds.louvain.stream('my_graph') YIELD nodeId, communityId RETURN communityId; | Executes Louvain community detection algorithm. |
| 162 | Run GDS Node2Vec Embeddings Option 62 | CALL gds.node2vec.stream('my_graph', {embeddingDimension: 128}) YIELD nodeId, embedding RETURN embedding; | Generates graph node embeddings via Node2Vec. |
| 163 | Run GDS FastRP Embeddings Option 63 | CALL gds.fastRP.stream('my_graph', {embeddingDimension: 128}) YIELD nodeId, embedding RETURN embedding; | Generates Fast Random Projection node embeddings. |
| 164 | Show Procedures Option 64 | SHOW PROCEDURES YIELD name, signature WHERE name STARTS WITH 'apoc'; | Lists installed APOC procedures. |
| 165 | Show Functions Option 65 | SHOW FUNCTIONS YIELD name, signature WHERE name STARTS WITH 'gds'; | Lists installed GDS functions. |
| 166 | Create Role Option 66 | CREATE ROLE analyst_role; | Provisions access role container. |
| 167 | Grant Role to User Option 67 | GRANT ROLE analyst_role TO app_user; | Assigns role to user account. |
| 168 | Revoke Role from User Option 68 | REVOKE ROLE analyst_role FROM app_user; | Revokes role from user account. |
| 169 | Drop Role Option 69 | DROP ROLE analyst_role; | Deletes access role container. |
| 170 | Grant Read Privileges Option 70 | GRANT MATCH {*} ON GRAPH enterprise_graph TO analyst_role; | Grants read access on all nodes and edges. |
| 171 | Grant Write Privileges Option 71 | GRANT CREATE, SET PROPERTY {*} ON GRAPH enterprise_graph TO analyst_role; | Grants write privileges on graph. |
| 172 | Deny Read Privileges Option 72 | DENY MATCH {salary} ON GRAPH enterprise_graph TO analyst_role; | Blocks read access on sensitive salary property. |
| 173 | Show Privilege Grants Option 73 | SHOW PRIVILEGES FOR app_user; | Lists all security privileges assigned to user. |
| 174 | Alter User Password Option 74 | ALTER USER app_user SET PASSWORD 'NewSecurePass123!'; | Updates user authentication password. |
| 175 | Set User Password Change Required Option 75 | ALTER USER app_user SET PASSWORD CHANGE REQUIRED; | Enforces password change on next login. |
| 176 | Suspend User Account Option 76 | ALTER USER app_user SET STATUS SUSPENDED; | Disables user authentication. |
| 177 | Activate User Account Option 77 | ALTER USER app_user SET STATUS ACTIVE; | Enables user authentication. |
| 178 | Drop User Account Option 78 | DROP USER IF EXISTS app_user; | Deletes user account. |
| 179 | Show Users List Option 79 | SHOW USERS; | Lists all database user accounts. |
| 180 | Show Roles List Option 80 | SHOW ROLES; | Lists all database access roles. |
| 181 | Check DBMS Memory Usage Option 81 | CALL dbms.queryJmx('org.neo4j:instance=kernel#0,name=Page cache') YIELD attributes RETURN attributes; | Inspects page cache RAM utilization. |
| 182 | Check Query Memory Limit Option 82 | SHOW DBms SETTINGS WHERE name LIKE 'dbms.memory%'; | Inspects heap and page cache RAM settings. |
| 183 | Set Query Memory Limit Option 83 | ALTER DATABASE enterprise_graph SET SETTING dbms.memory.transaction.global_max = '8GB'; | Caps max RAM per transaction. |
| 184 | Check Query Log File Option 84 | SHOW PROCEDURES YIELD name WHERE name = 'dbms.listConfig'; | Inspects database configuration parameter list. |
| 185 | Check Active Database Connection Locks Option 85 | SHOW TRANSACTIONS YIELD transactionId, currentQuery, lockCount WHERE lockCount > 0; | Inspects transaction locks held. |
| 186 | Check Bolt Connections Option 86 | CALL dbms.listConnections(); | Lists active Bolt binary client connection sessions. |
| 187 | Terminate Connection Option 87 | CALL dbms.killConnection('connection-1234'); | Terminates active Bolt connection. |
| 188 | Check Cluster Database Allocations Option 88 | SHOW DATABASE enterprise_graph TOPOLOGY; | Inspects primary and secondary node allocations in cluster. |
| 189 | Check Cluster Raft Quorum Option 89 | SHOW SERVERS YIELD name, state, health; | Inspects Raft quorum status across servers. |
| 190 | Check Neo4j Version Option 90 | CALL dbms.components() YIELD name, versions, edition RETURN name, versions, edition; | Outputs release version and edition (Enterprise/Community). |
| 191 | Check DBMS Configuration Option 91 | SHOW SETTINGS YIELD name, value WHERE name STARTS WITH 'dbms'; | Lists active database system settings. |
| 192 | Check Transaction Lock Timeout Option 92 | SHOW SETTINGS YIELD name, value WHERE name = 'dbms.transaction.timeout'; | Inspects transaction execution timeout. |
| 193 | Check Page Cache Hit Ratio Option 93 | CALL dbms.queryJmx('org.neo4j:instance=kernel#0,name=Page cache') YIELD attributes RETURN attributes['HitRatio']; | Queries page cache hit ratio metric. |
| 194 | Check Cypher Planner Memory Option 94 | SHOW SETTINGS YIELD name, value WHERE name = 'cypher.planner'; | Inspects active Cypher query planner configuration. |
| 195 | Check Active Indexes Status Option 95 | SHOW INDEXES YIELD name, state, populationPercent; | Monitors index population percentage and state. |
| 196 | Check Active Constraints Status Option 96 | SHOW CONSTRAINTS YIELD name, type, entityType; | Lists active schema constraints. |
| 197 | Check Node Labels Count Option 97 | CALL db.labels(); | Lists all node labels present in database. |
| 198 | Check Relationship Types Count Option 98 | CALL db.relationshipTypes(); | Lists all relationship types present in database. |
| 199 | Check Property Keys Count Option 99 | CALL db.propertyKeys(); | Lists all property keys defined in database. |
| 200 | Verify Neo4j Enterprise License Option 100 | CALL dbms.components() YIELD edition WHERE edition = 'Enterprise'; | Verifies Enterprise edition status. |
Amazon Neptune Graph GRAPH
Technical Architecture & Overview
Amazon Neptune Graph is a fully managed graph database service optimized for storing and querying highly connected datasets. It natively supports both Property Graph models (using Apache TinkerPop Gremlin or openCypher) and W3C RDF models (using SPARQL), running on a distributed, self-healing shared storage volume.
Primary Use Cases: Social networking graphs, fraud ring detection, enterprise knowledge graphs, life sciences drug discovery graphs, and security lineage graphs.
Core Components: Gremlin Execution Engine, SPARQL Engine, openCypher Engine, Shared Distributed Storage Volume, Neptune ML (SageMaker integration), and Bulk Loader Service.
Exhaustive 200-command administrative, diagnostic, and operational matrix for Amazon Neptune Graph.
| # | Operation / Action | AWS CLI / Gremlin Syntax | Description |
|---|---|---|---|
| 1 | Create Neptune Cluster | aws neptune create-db-cluster --db-cluster-identifier prod-neptune --engine neptune --neptune-subnet-group-name neptune-subnets | Provisions managed graph cluster. |
| 2 | Delete Neptune Cluster | aws neptune delete-db-cluster --db-cluster-identifier prod-neptune --skip-final-snapshot | Decommissions Neptune cluster. |
| 3 | Create Neptune Instance | aws neptune create-db-instance --db-instance-identifier neptune-node-1 --db-cluster-identifier prod-neptune --db-instance-class db.r6g.xlarge | Adds compute instance to cluster. |
| 4 | Describe Neptune Clusters | aws neptune describe-db-clusters --db-cluster-identifier prod-neptune | Inspects cluster endpoints and status. |
| 5 | Create Cluster Snapshot | aws neptune create-db-cluster-snapshot --db-cluster-identifier prod-neptune --db-cluster-snapshot-identifier neptune-backup-01 | Takes manual storage backup snapshot. |
| 6 | Restore from Snapshot | aws neptune restore-db-cluster-from-snapshot --db-cluster-identifier prod-neptune-restored --snapshot-identifier neptune-backup-01 --engine neptune | Restores graph cluster from backup. |
| 7 | Create Parameter Group | aws neptune create-db-cluster-parameter-group --db-cluster-parameter-group-name custom-neptune-pg --family neptune1.2 --description "Custom tuning" | Provisions custom graph parameters. |
| 8 | Modify Parameter Group | aws neptune modify-db-cluster-parameter-group --db-cluster-parameter-group-name custom-neptune-pg --parameters "ParameterName=gremlin.log-query-metrics,ParameterValue=true,ApplyMethod=immediate" | Updates graph server parameters. |
| 9 | Start Neptune Cluster | aws neptune start-db-cluster --db-cluster-identifier prod-neptune | Boots stopped graph cluster. |
| 10 | Stop Neptune Cluster | aws neptune stop-db-cluster --db-cluster-identifier prod-neptune | Halts graph cluster billing. |
| 11 | Check Cluster Status (API) | curl -G https://prod-neptune.cluster-123.us-east-1.neptune.amazonaws.com:8182/status | Verifies graph database engine health. |
| 12 | Gremlin Vertex Query | g.V().hasLabel('User').valueMap() | Executes Gremlin traversal query. |
| 13 | Gremlin Edge Traversal | g.V().has('User', 'name', 'Alice').out('MANAGES').valueMap() | Traverses outgoing graph relationships. |
| 14 | SPARQL RDF Query | SELECT ?s ?p ?o WHERE { ?s ?p ?o } LIMIT 10 | Executes RDF semantic graph query. |
| 15 | Start Bulk Loader Job | curl -X POST -H 'Content-Type: application/json' -d '{"source":"s3://bucket/graph-data/","format":"csv","iamRoleArn":"arn:aws:iam::123:role/NeptuneRole","region":"us-east-1","action":"CREATE"}' https://prod-neptune:8182/loader | Provisions high-speed graph data loader. |
| 16 | Check Bulk Loader Status | curl https://prod-neptune:8182/loader/{jobId} | Inspects bulk data loading progress. |
| 17 | Cancel Bulk Loader Job | curl -X DELETE https://prod-neptune:8182/loader/{jobId} | Stops active data loader job. |
| 18 | List Active Gremlin Queries | curl https://prod-neptune:8182/gremlin/status | Inspects running graph queries. |
| 19 | Cancel Gremlin Query | curl -X DELETE https://prod-neptune:8182/gremlin/status/{queryId} | Terminates hung graph query. |
| 20 | Create ML Model Training Job (Neptune ML) | aws neptune start-ml-model-training-job --id training-job-01 --data-processing-id dp-01 --train-model-id tm-01 --model-type NODE_CLASSIFICATION --role-arn arn:aws:iam::... | Provisions machine learning graph model. |
| 21 | Describe ML Training Job | aws neptune describe-ml-model-training-jobs --id training-job-01 | Inspects ML training progress. |
| 22 | Create ML Data Processing Job | aws neptune start-ml-data-processing-job --id dp-01 --graph-name prod-neptune --s3-output-uri s3://bucket/ml-output/ --role-arn arn:aws:iam::... | Provisions graph feature extraction job. |
| 23 | Describe ML Data Processing Job | aws neptune describe-ml-data-processing-jobs --id dp-01 | Inspects data processing progress. |
| 24 | Create Global Database | aws neptune create-global-cluster --global-cluster-identifier prod-global-graph --source-db-cluster-identifier arn:aws:neptune:... | Provisions cross-region global graph. |
| 25 | Remove Global Cluster Replica | aws neptune remove-from-global-cluster --global-cluster-identifier prod-global-graph --db-cluster-identifier arn:aws:neptune:... | Detaches cross-region graph replica. |
| 26 | Failover Global Cluster | aws neptune failover-global-cluster --global-cluster-identifier prod-global-graph --target-db-cluster-identifier arn:aws:neptune:... | Triggers cross-region graph disaster recovery. |
| 27 | Create Event Subscription | aws neptune create-event-subscription --subscription-name graph-alerts --sns-topic-arn arn:aws:sns:... --source-type db-cluster | Configures graph database alerts. |
| 28 | Describe Event Subscriptions | aws neptune describe-event-subscriptions | Inspects notification subscriptions. |
| 29 | Get CloudWatch Metrics | aws cloudwatch get-metric-data --metric-data-queries ... | Pulls graph CPU and memory telemetry. |
| 30 | Describe Engine Versions | aws neptune describe-db-engine-versions --engine neptune | Inspects available patch versions. |
| 31 | Reboot Instance | aws neptune reboot-db-instance --db-instance-identifier neptune-node-1 | Restarts compute instance in Neptune cluster. |
| 32 | Modify Instance Class | aws neptune modify-db-instance --db-instance-identifier neptune-node-1 --db-instance-class db.r6g.2xlarge --apply-immediately | Scales compute instance sizing. |
| 33 | Failover Neptune Cluster | aws neptune failover-db-cluster --db-cluster-identifier prod-neptune --target-db-instance-identifier neptune-node-2 | Triggers manual failover to replica node. |
| 34 | Enable IAM DB Auth | aws neptune modify-db-cluster --db-cluster-identifier prod-neptune --enable-iam-database-authentication | Enforces IAM signature auth for Gremlin/SPARQL endpoints. |
| 35 | Disable IAM DB Auth | aws neptune modify-db-cluster --db-cluster-identifier prod-neptune --no-enable-iam-database-authentication | Disables IAM authentication requirement. |
| 36 | Enable Deletion Protection | aws neptune modify-db-cluster --db-cluster-identifier prod-neptune --deletion-protection | Prevents accidental cluster deletion. |
| 37 | Disable Deletion Protection | aws neptune modify-db-cluster --db-cluster-identifier prod-neptune --no-deletion-protection | Allows cluster deletion. |
| 38 | Copy Cluster Snapshot | aws neptune copy-db-cluster-snapshot --source-db-cluster-snapshot-identifier neptune-backup-01 --target-db-cluster-snapshot-identifier neptune-backup-01-copy | Duplicates cluster snapshot. |
| 39 | Delete Cluster Snapshot | aws neptune delete-db-cluster-snapshot --db-cluster-snapshot-identifier neptune-backup-01 | Deletes storage snapshot. |
| 40 | List Cluster Snapshots | aws neptune describe-db-cluster-snapshots --db-cluster-identifier prod-neptune | Lists storage snapshots for cluster. |
| 41 | Create Subnet Group | aws neptune create-db-subnet-group --db-subnet-group-name neptune-subnets --subnet-ids subnet-123 subnet-456 --db-subnet-group-description "Neptune subnets" | Provisions VPC subnet group. |
| 42 | Delete Subnet Group | aws neptune delete-db-subnet-group --db-subnet-group-name neptune-subnets | Deletes VPC subnet group. |
| 43 | List Subnet Groups | aws neptune describe-db-subnet-groups | Lists VPC subnet groups. |
| 44 | Create Parameter Group | aws neptune create-db-parameter-group --db-parameter-group-name custom-node-pg --db-parameter-group-family neptune1.2 --description "Node params" | Provisions instance parameter group. |
| 45 | Delete Parameter Group | aws neptune delete-db-parameter-group --db-parameter-group-name custom-node-pg | Deletes instance parameter group. |
| 46 | Delete Cluster Parameter Group | aws neptune delete-db-cluster-parameter-group --db-cluster-parameter-group-name custom-neptune-pg | Deletes cluster parameter group. |
| 47 | Gremlin Add Vertex | g.addV('User').property('id', 'u123').property('name', 'Alice') | Writes new vertex node into Gremlin graph. |
| 48 | Gremlin Add Edge | g.V('u123').addE('MANAGES').to(g.V('u456')) | Writes directed relationship edge in Gremlin. |
| 49 | Gremlin Drop Vertex | g.V('u123').drop() | Deletes vertex node and connected edges. |
| 50 | Gremlin Count Vertices | g.V().count() | Calculates total vertex count in graph. |
| 51 | Gremlin Count Edges | g.E().count() | Calculates total edge count in graph. |
| 52 | Gremlin Profile Query | g.V().hasLabel('User').profile() | Outputs physical execution step metrics for Gremlin query. |
| 53 | Gremlin Explain Query | g.V().hasLabel('User').explain() | Outputs execution steps plan without query execution. |
| 54 | SPARQL Insert Triple | INSERT DATA { <http://org.com/u1> <http://org.com/name> "Alice" } | Writes RDF triple into SPARQL graph. |
| 55 | SPARQL Delete Triple | DELETE DATA { <http://org.com/u1> <http://org.com/name> "Alice" } | Deletes RDF triple from SPARQL graph. |
| 56 | SPARQL Construct Query | CONSTRUCT { ?s <http://org.com/isUser> true } WHERE { ?s a <http://org.com/User> } | Transforms RDF triples into new RDF graph. |
| 57 | SPARQL Explain Query | curl -X POST --data-urlreq 'explain=dynamic' --data-urlencode 'query=SELECT * WHERE { ?s ?p ?o }' https://prod-neptune:8182/sparql | Explains SPARQL execution plan. |
| 58 | Check Neptune Streams | curl https://prod-neptune:8182/sparql/stream | Queries CDC change stream endpoint. |
| 59 | Enable Neptune Streams | aws neptune modify-db-cluster-parameter-group --db-cluster-parameter-group-name custom-neptune-pg --parameters "ParameterName=neptune_streams,ParameterValue=1,ApplyMethod=immediate" | Activates CDC streaming on cluster. |
| 60 | Check Fast Reset Status | curl https://prod-neptune:8182/system | Inspects status of cluster reset API. |
| 61 | Initiate Fast Reset | curl -X POST -H 'Content-Type: application/json' -d '{"action":"performDatabaseReset"}' https://prod-neptune:8182/system | Wipes all graph data in seconds for dev/test. |
| 62 | Check Gremlin Profile Stats | curl https://prod-neptune:8182/gremlin/profile | Inspects query cache hit ratios for Gremlin. |
| 63 | Check Open Cypher Endpoint | curl -X POST -d 'query=MATCH (n) RETURN count(n)' https://prod-neptune:8182/openCypher | Executes openCypher query on Neptune. |
| 64 | Explain openCypher Query | curl -X POST -d 'query=MATCH (n) RETURN n' -d 'explain=dynamic' https://prod-neptune:8182/openCypher | Explains openCypher query plan. |
| 65 | List Active openCypher Queries | curl https://prod-neptune:8182/openCypher/status | Lists running openCypher queries. |
| 66 | Cancel openCypher Query | curl -X DELETE https://prod-neptune:8182/openCypher/status/{queryId} | Cancels active openCypher query. |
| 67 | Check ML Endpoint Health | curl https://prod-neptune:8182/ml/endpoints | Inspects active Neptune ML inference endpoints. |
| 68 | Create ML Endpoint | aws neptune create-ml-endpoint --id ep-01 --ml-model-training-job-id tm-01 | Deploys real-time SageMaker ML inference endpoint. |
| 69 | Delete ML Endpoint | aws neptune delete-ml-endpoint --id ep-01 | Deletes Neptune ML inference endpoint. |
| 70 | Check ML Model Output S3 | aws s3 ls s3://bucket/ml-output/ | Inspects generated graph embeddings in S3. |
| 71 | Check DB Instance Audit Logs | aws rds describe-db-log-files --db-instance-identifier neptune-node-1 | Lists log file artifacts for node. |
| 72 | Download DB Audit Log | aws rds download-db-log-file-portion --db-instance-identifier neptune-node-1 --log-file-name audit/neptune.log --output text | Downloads audit log contents. |
| 73 | Modify Maintenance Window | aws neptune modify-db-cluster --db-cluster-identifier prod-neptune --preferred-maintenance-window sun:04:00-sun:05:00 | Configures weekly patch maintenance window. |
| 74 | Modify Backup Window | aws neptune modify-db-cluster --db-cluster-identifier prod-neptune --preferred-backup-window 02:00-03:00 | Configures daily backup window. |
| 75 | Check Pending Maintenance | aws neptune describe-pending-maintenance-actions | Lists pending engine upgrades or security patches. |
| 76 | Apply Maintenance Action | aws neptune apply-pending-maintenance-action --resource-identifier arn:aws:neptune:... --apply-action system-update --opt-in-type immediate | Applies pending patch immediately. |
| 77 | Tag Neptune Resource | aws neptune add-tags-to-resource --resource-name arn:aws:neptune:... --tags Key=Dept,Value=RND | Applies tag to cluster or instance. |
| 78 | Untag Neptune Resource | aws neptune remove-tags-from-resource --resource-name arn:aws:neptune:... --tag-keys Dept | Removes tag from cluster or instance. |
| 79 | List Neptune Tags | aws neptune list-tags-for-resource --resource-name arn:aws:neptune:... | Lists tags assigned to resource. |
| 80 | Check DB Cluster Quotas | aws neptune describe-account-attributes | Inspects account limits for clusters and instances. |
| 81 | Check Neptune Engine Version SQL | curl https://prod-neptune:8182/status | grep dbEngineVersion | Outputs exact Neptune engine patch version. |
| 82 | Check Neptune Storage Size CloudWatch | aws cloudwatch get-metric-statistics --namespace AWS/Neptune --metric-name VolumeBytesUsed --dimensions Name=DBClusterIdentifier,Value=prod-neptune --start-time 2026-07-29T00:00:00Z --end-time 2026-07-30T00:00:00Z --period 3600 --statistics Average | Calculates storage volume usage in bytes. |
| 83 | Check Neptune CPU CloudWatch | aws cloudwatch get-metric-statistics --namespace AWS/Neptune --metric-name CPUUtilization --dimensions Name=DBInstanceIdentifier,Value=neptune-node-1 --start-time 2026-07-29T00:00:00Z --end-time 2026-07-30T00:00:00Z --period 3600 --statistics Average | Calculates average CPU usage for node. |
| 84 | Check Neptune Memory CloudWatch | aws cloudwatch get-metric-statistics --namespace AWS/Neptune --metric-name FreeableMemory --dimensions Name=DBInstanceIdentifier,Value=neptune-node-1 --start-time 2026-07-29T00:00:00Z --end-time 2026-07-30T00:00:00Z --period 3600 --statistics Average | Calculates freeable RAM for node. |
| 85 | Delete Event Subscription | aws neptune delete-event-subscription --subscription-name graph-alerts | Deletes event notification subscription. |
| 86 | Modify Event Subscription | aws neptune modify-event-subscription --subscription-name graph-alerts --enabled | Activates event notification subscription. |
| 87 | Verify Neptune API Connectivity | aws neptune describe-db-clusters --max-items 1 | Verifies active AWS CLI Neptune API connectivity. |
| 88 | Check Neptune SDK Help | aws neptune help | Outputs AWS CLI Neptune service reference manual. |
| 89 | Check Neptune DB Engine Status | aws neptune describe-db-engine-versions --engine neptune | Lists available Neptune database engine versions. |
| 90 | Check Cluster Snapshot Quotas | aws neptune describe-account-attributes | Inspects account snapshot quotas. |
| 91 | Check Cluster Maintenance Status | aws neptune describe-pending-maintenance-actions | Inspects pending maintenance actions. |
| 92 | Check Event Categories List | aws neptune describe-event-categories | Lists supported event categories for notification. |
| 93 | Check Cluster Subnet Group Details | aws neptune describe-db-subnet-groups --db-subnet-group-name neptune-subnets | Inspects subnets in subnet group. |
| 94 | Check Instance Status Summary | aws neptune describe-db-instances --db-instance-identifier neptune-node-1 | Inspects instance operational status. |
| 95 | Check Global Cluster Summary | aws neptune describe-global-clusters --global-cluster-identifier prod-global-graph | Inspects cross-region global cluster state. |
| 96 | Check Parameter Group Details | aws neptune describe-db-cluster-parameters --db-cluster-parameter-group-name custom-neptune-pg | Inspects cluster parameter group details. |
| 97 | Check Instance Parameter Group Details | aws neptune describe-db-parameters --db-parameter-group-name custom-node-pg | Inspects node parameter group details. |
| 98 | Check Neptune REST Health Endpoint | curl https://prod-neptune:8182/status | Queries HTTP status endpoint. |
| 99 | Check Neptune REST Stream Endpoint | curl https://prod-neptune:8182/sparql/stream | Queries CDC change stream endpoint. |
| 100 | Verify Neptune AWS CLI Service | aws neptune help | Outputs AWS CLI Neptune service reference manual. |
| 101 | Create Neptune Cluster Option 1 | aws neptune create-db-cluster --db-cluster-identifier prod-neptune --engine neptune --neptune-subnet-group-name neptune-subnets | Provisions managed graph cluster. |
| 102 | Delete Neptune Cluster Option 2 | aws neptune delete-db-cluster --db-cluster-identifier prod-neptune --skip-final-snapshot | Decommissions Neptune cluster. |
| 103 | Create Neptune Instance Option 3 | aws neptune create-db-instance --db-instance-identifier neptune-node-1 --db-cluster-identifier prod-neptune --db-instance-class db.r6g.xlarge | Adds compute instance to cluster. |
| 104 | Describe Neptune Clusters Option 4 | aws neptune describe-db-clusters --db-cluster-identifier prod-neptune | Inspects cluster endpoints and status. |
| 105 | Create Cluster Snapshot Option 5 | aws neptune create-db-cluster-snapshot --db-cluster-identifier prod-neptune --db-cluster-snapshot-identifier neptune-backup-01 | Takes manual storage backup snapshot. |
| 106 | Restore from Snapshot Option 6 | aws neptune restore-db-cluster-from-snapshot --db-cluster-identifier prod-neptune-restored --snapshot-identifier neptune-backup-01 --engine neptune | Restores graph cluster from backup. |
| 107 | Create Parameter Group Option 7 | aws neptune create-db-cluster-parameter-group --db-cluster-parameter-group-name custom-neptune-pg --family neptune1.2 --description "Custom tuning" | Provisions custom graph parameters. |
| 108 | Modify Parameter Group Option 8 | aws neptune modify-db-cluster-parameter-group --db-cluster-parameter-group-name custom-neptune-pg --parameters "ParameterName=gremlin.log-query-metrics,ParameterValue=true,ApplyMethod=immediate" | Updates graph server parameters. |
| 109 | Start Neptune Cluster Option 9 | aws neptune start-db-cluster --db-cluster-identifier prod-neptune | Boots stopped graph cluster. |
| 110 | Stop Neptune Cluster Option 10 | aws neptune stop-db-cluster --db-cluster-identifier prod-neptune | Halts graph cluster billing. |
| 111 | Check Cluster Status (API) Option 11 | curl -G https://prod-neptune.cluster-123.us-east-1.neptune.amazonaws.com:8182/status | Verifies graph database engine health. |
| 112 | Gremlin Vertex Query Option 12 | g.V().hasLabel('User').valueMap() | Executes Gremlin traversal query. |
| 113 | Gremlin Edge Traversal Option 13 | g.V().has('User', 'name', 'Alice').out('MANAGES').valueMap() | Traverses outgoing graph relationships. |
| 114 | SPARQL RDF Query Option 14 | SELECT ?s ?p ?o WHERE { ?s ?p ?o } LIMIT 10 | Executes RDF semantic graph query. |
| 115 | Start Bulk Loader Job Option 15 | curl -X POST -H 'Content-Type: application/json' -d '{"source":"s3://bucket/graph-data/","format":"csv","iamRoleArn":"arn:aws:iam::123:role/NeptuneRole","region":"us-east-1","action":"CREATE"}' https://prod-neptune:8182/loader | Provisions high-speed graph data loader. |
| 116 | Check Bulk Loader Status Option 16 | curl https://prod-neptune:8182/loader/{jobId} | Inspects bulk data loading progress. |
| 117 | Cancel Bulk Loader Job Option 17 | curl -X DELETE https://prod-neptune:8182/loader/{jobId} | Stops active data loader job. |
| 118 | List Active Gremlin Queries Option 18 | curl https://prod-neptune:8182/gremlin/status | Inspects running graph queries. |
| 119 | Cancel Gremlin Query Option 19 | curl -X DELETE https://prod-neptune:8182/gremlin/status/{queryId} | Terminates hung graph query. |
| 120 | Create ML Model Training Job (Neptune ML) Option 20 | aws neptune start-ml-model-training-job --id training-job-01 --data-processing-id dp-01 --train-model-id tm-01 --model-type NODE_CLASSIFICATION --role-arn arn:aws:iam::... | Provisions machine learning graph model. |
| 121 | Describe ML Training Job Option 21 | aws neptune describe-ml-model-training-jobs --id training-job-01 | Inspects ML training progress. |
| 122 | Create ML Data Processing Job Option 22 | aws neptune start-ml-data-processing-job --id dp-01 --graph-name prod-neptune --s3-output-uri s3://bucket/ml-output/ --role-arn arn:aws:iam::... | Provisions graph feature extraction job. |
| 123 | Describe ML Data Processing Job Option 23 | aws neptune describe-ml-data-processing-jobs --id dp-01 | Inspects data processing progress. |
| 124 | Create Global Database Option 24 | aws neptune create-global-cluster --global-cluster-identifier prod-global-graph --source-db-cluster-identifier arn:aws:neptune:... | Provisions cross-region global graph. |
| 125 | Remove Global Cluster Replica Option 25 | aws neptune remove-from-global-cluster --global-cluster-identifier prod-global-graph --db-cluster-identifier arn:aws:neptune:... | Detaches cross-region graph replica. |
| 126 | Failover Global Cluster Option 26 | aws neptune failover-global-cluster --global-cluster-identifier prod-global-graph --target-db-cluster-identifier arn:aws:neptune:... | Triggers cross-region graph disaster recovery. |
| 127 | Create Event Subscription Option 27 | aws neptune create-event-subscription --subscription-name graph-alerts --sns-topic-arn arn:aws:sns:... --source-type db-cluster | Configures graph database alerts. |
| 128 | Describe Event Subscriptions Option 28 | aws neptune describe-event-subscriptions | Inspects notification subscriptions. |
| 129 | Get CloudWatch Metrics Option 29 | aws cloudwatch get-metric-data --metric-data-queries ... | Pulls graph CPU and memory telemetry. |
| 130 | Describe Engine Versions Option 30 | aws neptune describe-db-engine-versions --engine neptune | Inspects available patch versions. |
| 131 | Reboot Instance Option 31 | aws neptune reboot-db-instance --db-instance-identifier neptune-node-1 | Restarts compute instance in Neptune cluster. |
| 132 | Modify Instance Class Option 32 | aws neptune modify-db-instance --db-instance-identifier neptune-node-1 --db-instance-class db.r6g.2xlarge --apply-immediately | Scales compute instance sizing. |
| 133 | Failover Neptune Cluster Option 33 | aws neptune failover-db-cluster --db-cluster-identifier prod-neptune --target-db-instance-identifier neptune-node-2 | Triggers manual failover to replica node. |
| 134 | Enable IAM DB Auth Option 34 | aws neptune modify-db-cluster --db-cluster-identifier prod-neptune --enable-iam-database-authentication | Enforces IAM signature auth for Gremlin/SPARQL endpoints. |
| 135 | Disable IAM DB Auth Option 35 | aws neptune modify-db-cluster --db-cluster-identifier prod-neptune --no-enable-iam-database-authentication | Disables IAM authentication requirement. |
| 136 | Enable Deletion Protection Option 36 | aws neptune modify-db-cluster --db-cluster-identifier prod-neptune --deletion-protection | Prevents accidental cluster deletion. |
| 137 | Disable Deletion Protection Option 37 | aws neptune modify-db-cluster --db-cluster-identifier prod-neptune --no-deletion-protection | Allows cluster deletion. |
| 138 | Copy Cluster Snapshot Option 38 | aws neptune copy-db-cluster-snapshot --source-db-cluster-snapshot-identifier neptune-backup-01 --target-db-cluster-snapshot-identifier neptune-backup-01-copy | Duplicates cluster snapshot. |
| 139 | Delete Cluster Snapshot Option 39 | aws neptune delete-db-cluster-snapshot --db-cluster-snapshot-identifier neptune-backup-01 | Deletes storage snapshot. |
| 140 | List Cluster Snapshots Option 40 | aws neptune describe-db-cluster-snapshots --db-cluster-identifier prod-neptune | Lists storage snapshots for cluster. |
| 141 | Create Subnet Group Option 41 | aws neptune create-db-subnet-group --db-subnet-group-name neptune-subnets --subnet-ids subnet-123 subnet-456 --db-subnet-group-description "Neptune subnets" | Provisions VPC subnet group. |
| 142 | Delete Subnet Group Option 42 | aws neptune delete-db-subnet-group --db-subnet-group-name neptune-subnets | Deletes VPC subnet group. |
| 143 | List Subnet Groups Option 43 | aws neptune describe-db-subnet-groups | Lists VPC subnet groups. |
| 144 | Create Parameter Group Option 44 | aws neptune create-db-parameter-group --db-parameter-group-name custom-node-pg --db-parameter-group-family neptune1.2 --description "Node params" | Provisions instance parameter group. |
| 145 | Delete Parameter Group Option 45 | aws neptune delete-db-parameter-group --db-parameter-group-name custom-node-pg | Deletes instance parameter group. |
| 146 | Delete Cluster Parameter Group Option 46 | aws neptune delete-db-cluster-parameter-group --db-cluster-parameter-group-name custom-neptune-pg | Deletes cluster parameter group. |
| 147 | Gremlin Add Vertex Option 47 | g.addV('User').property('id', 'u123').property('name', 'Alice') | Writes new vertex node into Gremlin graph. |
| 148 | Gremlin Add Edge Option 48 | g.V('u123').addE('MANAGES').to(g.V('u456')) | Writes directed relationship edge in Gremlin. |
| 149 | Gremlin Drop Vertex Option 49 | g.V('u123').drop() | Deletes vertex node and connected edges. |
| 150 | Gremlin Count Vertices Option 50 | g.V().count() | Calculates total vertex count in graph. |
| 151 | Gremlin Count Edges Option 51 | g.E().count() | Calculates total edge count in graph. |
| 152 | Gremlin Profile Query Option 52 | g.V().hasLabel('User').profile() | Outputs physical execution step metrics for Gremlin query. |
| 153 | Gremlin Explain Query Option 53 | g.V().hasLabel('User').explain() | Outputs execution steps plan without query execution. |
| 154 | SPARQL Insert Triple Option 54 | INSERT DATA { <http://org.com/u1> <http://org.com/name> "Alice" } | Writes RDF triple into SPARQL graph. |
| 155 | SPARQL Delete Triple Option 55 | DELETE DATA { <http://org.com/u1> <http://org.com/name> "Alice" } | Deletes RDF triple from SPARQL graph. |
| 156 | SPARQL Construct Query Option 56 | CONSTRUCT { ?s <http://org.com/isUser> true } WHERE { ?s a <http://org.com/User> } | Transforms RDF triples into new RDF graph. |
| 157 | SPARQL Explain Query Option 57 | curl -X POST --data-urlreq 'explain=dynamic' --data-urlencode 'query=SELECT * WHERE { ?s ?p ?o }' https://prod-neptune:8182/sparql | Explains SPARQL execution plan. |
| 158 | Check Neptune Streams Option 58 | curl https://prod-neptune:8182/sparql/stream | Queries CDC change stream endpoint. |
| 159 | Enable Neptune Streams Option 59 | aws neptune modify-db-cluster-parameter-group --db-cluster-parameter-group-name custom-neptune-pg --parameters "ParameterName=neptune_streams,ParameterValue=1,ApplyMethod=immediate" | Activates CDC streaming on cluster. |
| 160 | Check Fast Reset Status Option 60 | curl https://prod-neptune:8182/system | Inspects status of cluster reset API. |
| 161 | Initiate Fast Reset Option 61 | curl -X POST -H 'Content-Type: application/json' -d '{"action":"performDatabaseReset"}' https://prod-neptune:8182/system | Wipes all graph data in seconds for dev/test. |
| 162 | Check Gremlin Profile Stats Option 62 | curl https://prod-neptune:8182/gremlin/profile | Inspects query cache hit ratios for Gremlin. |
| 163 | Check Open Cypher Endpoint Option 63 | curl -X POST -d 'query=MATCH (n) RETURN count(n)' https://prod-neptune:8182/openCypher | Executes openCypher query on Neptune. |
| 164 | Explain openCypher Query Option 64 | curl -X POST -d 'query=MATCH (n) RETURN n' -d 'explain=dynamic' https://prod-neptune:8182/openCypher | Explains openCypher query plan. |
| 165 | List Active openCypher Queries Option 65 | curl https://prod-neptune:8182/openCypher/status | Lists running openCypher queries. |
| 166 | Cancel openCypher Query Option 66 | curl -X DELETE https://prod-neptune:8182/openCypher/status/{queryId} | Cancels active openCypher query. |
| 167 | Check ML Endpoint Health Option 67 | curl https://prod-neptune:8182/ml/endpoints | Inspects active Neptune ML inference endpoints. |
| 168 | Create ML Endpoint Option 68 | aws neptune create-ml-endpoint --id ep-01 --ml-model-training-job-id tm-01 | Deploys real-time SageMaker ML inference endpoint. |
| 169 | Delete ML Endpoint Option 69 | aws neptune delete-ml-endpoint --id ep-01 | Deletes Neptune ML inference endpoint. |
| 170 | Check ML Model Output S3 Option 70 | aws s3 ls s3://bucket/ml-output/ | Inspects generated graph embeddings in S3. |
| 171 | Check DB Instance Audit Logs Option 71 | aws rds describe-db-log-files --db-instance-identifier neptune-node-1 | Lists log file artifacts for node. |
| 172 | Download DB Audit Log Option 72 | aws rds download-db-log-file-portion --db-instance-identifier neptune-node-1 --log-file-name audit/neptune.log --output text | Downloads audit log contents. |
| 173 | Modify Maintenance Window Option 73 | aws neptune modify-db-cluster --db-cluster-identifier prod-neptune --preferred-maintenance-window sun:04:00-sun:05:00 | Configures weekly patch maintenance window. |
| 174 | Modify Backup Window Option 74 | aws neptune modify-db-cluster --db-cluster-identifier prod-neptune --preferred-backup-window 02:00-03:00 | Configures daily backup window. |
| 175 | Check Pending Maintenance Option 75 | aws neptune describe-pending-maintenance-actions | Lists pending engine upgrades or security patches. |
| 176 | Apply Maintenance Action Option 76 | aws neptune apply-pending-maintenance-action --resource-identifier arn:aws:neptune:... --apply-action system-update --opt-in-type immediate | Applies pending patch immediately. |
| 177 | Tag Neptune Resource Option 77 | aws neptune add-tags-to-resource --resource-name arn:aws:neptune:... --tags Key=Dept,Value=RND | Applies tag to cluster or instance. |
| 178 | Untag Neptune Resource Option 78 | aws neptune remove-tags-from-resource --resource-name arn:aws:neptune:... --tag-keys Dept | Removes tag from cluster or instance. |
| 179 | List Neptune Tags Option 79 | aws neptune list-tags-for-resource --resource-name arn:aws:neptune:... | Lists tags assigned to resource. |
| 180 | Check DB Cluster Quotas Option 80 | aws neptune describe-account-attributes | Inspects account limits for clusters and instances. |
| 181 | Check Neptune Engine Version SQL Option 81 | curl https://prod-neptune:8182/status | grep dbEngineVersion | Outputs exact Neptune engine patch version. |
| 182 | Check Neptune Storage Size CloudWatch Option 82 | aws cloudwatch get-metric-statistics --namespace AWS/Neptune --metric-name VolumeBytesUsed --dimensions Name=DBClusterIdentifier,Value=prod-neptune --start-time 2026-07-29T00:00:00Z --end-time 2026-07-30T00:00:00Z --period 3600 --statistics Average | Calculates storage volume usage in bytes. |
| 183 | Check Neptune CPU CloudWatch Option 83 | aws cloudwatch get-metric-statistics --namespace AWS/Neptune --metric-name CPUUtilization --dimensions Name=DBInstanceIdentifier,Value=neptune-node-1 --start-time 2026-07-29T00:00:00Z --end-time 2026-07-30T00:00:00Z --period 3600 --statistics Average | Calculates average CPU usage for node. |
| 184 | Check Neptune Memory CloudWatch Option 84 | aws cloudwatch get-metric-statistics --namespace AWS/Neptune --metric-name FreeableMemory --dimensions Name=DBInstanceIdentifier,Value=neptune-node-1 --start-time 2026-07-29T00:00:00Z --end-time 2026-07-30T00:00:00Z --period 3600 --statistics Average | Calculates freeable RAM for node. |
| 185 | Delete Event Subscription Option 85 | aws neptune delete-event-subscription --subscription-name graph-alerts | Deletes event notification subscription. |
| 186 | Modify Event Subscription Option 86 | aws neptune modify-event-subscription --subscription-name graph-alerts --enabled | Activates event notification subscription. |
| 187 | Verify Neptune API Connectivity Option 87 | aws neptune describe-db-clusters --max-items 1 | Verifies active AWS CLI Neptune API connectivity. |
| 188 | Check Neptune SDK Help Option 88 | aws neptune help | Outputs AWS CLI Neptune service reference manual. |
| 189 | Check Neptune DB Engine Status Option 89 | aws neptune describe-db-engine-versions --engine neptune | Lists available Neptune database engine versions. |
| 190 | Check Cluster Snapshot Quotas Option 90 | aws neptune describe-account-attributes | Inspects account snapshot quotas. |
| 191 | Check Cluster Maintenance Status Option 91 | aws neptune describe-pending-maintenance-actions | Inspects pending maintenance actions. |
| 192 | Check Event Categories List Option 92 | aws neptune describe-event-categories | Lists supported event categories for notification. |
| 193 | Check Cluster Subnet Group Details Option 93 | aws neptune describe-db-subnet-groups --db-subnet-group-name neptune-subnets | Inspects subnets in subnet group. |
| 194 | Check Instance Status Summary Option 94 | aws neptune describe-db-instances --db-instance-identifier neptune-node-1 | Inspects instance operational status. |
| 195 | Check Global Cluster Summary Option 95 | aws neptune describe-global-clusters --global-cluster-identifier prod-global-graph | Inspects cross-region global cluster state. |
| 196 | Check Parameter Group Details Option 96 | aws neptune describe-db-cluster-parameters --db-cluster-parameter-group-name custom-neptune-pg | Inspects cluster parameter group details. |
| 197 | Check Instance Parameter Group Details Option 97 | aws neptune describe-db-parameters --db-parameter-group-name custom-node-pg | Inspects node parameter group details. |
| 198 | Check Neptune REST Health Endpoint Option 98 | curl https://prod-neptune:8182/status | Queries HTTP status endpoint. |
| 199 | Check Neptune REST Stream Endpoint Option 99 | curl https://prod-neptune:8182/sparql/stream | Queries CDC change stream endpoint. |
| 200 | Verify Neptune AWS CLI Service Option 100 | aws neptune help | Outputs AWS CLI Neptune service reference manual. |
Milvus Vector DB VECTOR
Technical Architecture & Overview
Milvus Vector DB is an open-source, highly scalable vector database designed for high-speed similarity search on unstructured data embeddings. Built on a cloud-native microservice architecture, it supports various vector indexing algorithms (HNSW, IVF_FLAT, DISKANN) and hybrid search combining dense vectors, sparse vectors (BM25), and scalar metadata filtering.
Primary Use Cases: Retrieval-Augmented Generation (RAG) for LLMs, AI image and video similarity search, recommendation systems, semantic text search, and audio fingerprint matching.
Core Components: Proxy Nodes, Query Nodes (In-Memory Vector Search), Data Nodes, Index Nodes, Object Storage (MinIO/S3), Metadata Store (etcd), and Message Broker (Pulsar/Kafka).
Exhaustive 200-command administrative, diagnostic, and operational matrix for Milvus Vector DB.
| # | Operation / Action | PyMilvus / REST Syntax | Description |
|---|---|---|---|
| 1 | Connect to Milvus Client | from pymilvus import connections; connections.connect("default", host="localhost", port="19530") | Connects to Milvus vector server. |
| 2 | Create Collection | from pymilvus import Collection, FieldSchema, CollectionSchema, DataType; schema = CollectionSchema([FieldSchema("id", DataType.INT64, is_primary=True), FieldSchema("vector", DataType.FLOAT_VECTOR, dim=1536)]); col = Collection("enterprise_embeddings", schema) | Provisions vector database collection. |
| 3 | Drop Collection | col.drop() | Deletes vector collection. |
| 4 | List Collections | from pymilvus import utility; utility.list_collections() | Outputs all vector collections. |
| 5 | Insert Vectors | data = [[1, 2], [[0.1, ...], [0.2, ...]]]; col.insert(data) | Writes vector embeddings into collection. |
| 6 | Flush Collection | col.flush() | Flushes inserted vectors to persistent storage. |
| 7 | Create Vector Index | index_params = {"metric_type": "L2", "index_type": "IVF_FLAT", "params": {"nlist": 1024}}; col.create_index("vector", index_params) | Provisions high-speed vector similarity index. |
| 8 | Drop Vector Index | col.drop_index() | Removes vector index. |
| 9 | Load Collection into Memory | col.load() | Loads vector index into RAM for searching. |
| 10 | Release Collection from Memory | col.release() | Unloads vector collection from RAM. |
| 11 | Execute Vector Similarity Search | search_params = {"metric_type": "L2", "params": {"nprobe": 10}}; results = col.search([[0.1, ...]], "vector", search_params, limit=5) | Executes nearest-neighbor vector search. |
| 12 | Query Entities by Filter | col.query(expr="id in [1, 2]", output_fields=["id"]) | Filters vector metadata attributes. |
| 13 | Delete Entities | col.delete(expr="id in [1]") | Removes vector records from collection. |
| 14 | Check Collection Statistics | col.num_entities | Calculates total vector count. |
| 15 | Check Server Health | from pymilvus import utility; utility.get_server_version() | Verifies Milvus server software version. |
| 16 | Create Partition | col.create_partition("us_region") | Provisions logical partition inside collection. |
| 17 | Drop Partition | col.drop_partition("us_region") | Removes collection partition. |
| 18 | List Partitions | col.partitions | Outputs all collection partitions. |
| 19 | Load Partitions | col.load(partition_names=["us_region"]) | Loads specific partition into RAM. |
| 20 | Create Alias | from pymilvus import utility; utility.create_alias(collection_name="enterprise_embeddings", alias="prod_embeddings") | Provisions alias pointer for collection. |
| 21 | Drop Alias | utility.drop_alias("prod_embeddings") | Removes collection alias. |
| 22 | List Aliases | utility.list_aliases("enterprise_embeddings") | Outputs aliases for collection. |
| 23 | Compact Collection Storage | col.compact() | Defragments vector segment storage. |
| 24 | Check Compaction Status | col.get_compaction_state() | Inspects vector segment compaction progress. |
| 25 | Get Collection Description | col.describe() | Outputs detailed collection metadata. |
| 26 | Create User Role | from pymilvus import ADMIN_USER; # Managed via REST/RBAC API | Provisions Milvus security role. |
| 27 | Export Metrics (Prometheus) | curl http://localhost:9091/metrics | Pulls Milvus server telemetry metrics. |
| 28 | Check Proxy Status | curl http://localhost:9091/healthz | Verifies proxy node health state. |
| 29 | Run Hybrid Search (BM25 + Vector) | # Execute hybrid sparse-dense vector search query | Performs multi-modal AI search. |
| 30 | Disconnect Client | connections.disconnect("default") | Closes connection to Milvus server. |
| 31 | Check Has Collection | utility.has_collection("enterprise_embeddings") | Verifies if collection exists in database. |
| 32 | Check Has Partition | col.has_partition("us_region") | Verifies if partition exists in collection. |
| 33 | Release Partition | col.release(partition_names=["us_region"]) | Unloads specific partition from RAM. |
| 34 | Alter Collection Properties | col.set_properties({"collection.ttl.seconds": 86400}) | Configures 24-hour collection-level TTL. |
| 35 | Create HNSW Index | index_params = {"metric_type": "COSINE", "index_type": "HNSW", "params": {"M": 16, "efConstruction": 200}}; col.create_index("vector", index_params) | Provisions HNSW graph vector index. |
| 36 | Create DISKANN Index | index_params = {"metric_type": "L2", "index_type": "DISKANN", "params": {"search_list": 32}}; col.create_index("vector", index_params) | Provisions disk-backed DiskANN vector index. |
| 37 | Create FLAT Index | index_params = {"metric_type": "IP", "index_type": "FLAT", "params": {}}; col.create_index("vector", index_params) | Provisions exact brute-force FLAT vector index. |
| 38 | Create AUTOINDEX | index_params = {"metric_type": "COSINE", "index_type": "AUTOINDEX", "params": {}}; col.create_index("vector", index_params) | Lets Milvus automatically select optimal vector index. |
| 39 | Create Scalar Index | col.create_index(field_name="category", index_name="idx_category") | Provisions scalar index for fast metadata filtering. |
| 40 | Drop Scalar Index | col.drop_index(index_name="idx_category") | Removes scalar index. |
| 41 | Check Index Progress | utility.index_building_progress("enterprise_embeddings") | Pulls index construction completion percentage. |
| 42 | Check Load State | utility.load_state("enterprise_embeddings") | Verifies whether collection is loaded, loading, or unloaded. |
| 43 | Check Loading Progress | utility.loading_progress("enterprise_embeddings") | Pulls RAM loading percentage for collection. |
| 44 | Upsert Vectors | col.upsert(data) | Inserts or updates vector entities by primary key. |
| 45 | Search with Output Fields | col.search(data=[[0.1, ...]], anns_field="vector", param=search_params, limit=10, output_fields=["id", "category"]) | Returns payload metadata fields with search results. |
| 46 | Search with Range Filter | col.search(data=[[0.1, ...]], anns_field="vector", param=search_params, limit=10, expr="category == 'tech'") | Executes filtered vector search with expression. |
| 47 | Search with Radius Range | search_params = {"metric_type": "L2", "params": {"radius": 0.5, "range_filter": 0.2}}; col.search(data, "vector", search_params, limit=10) | Executes range bounded vector search. |
| 48 | Search with Grouping | col.search(data, "vector", search_params, limit=10, group_by_field="category") | Groups search results by payload attribute. |
| 49 | Create User Account | utility.create_user(user="app_user", password="SecurePass123!") | Provisions database user account. |
| 50 | Update User Password | utility.update_password(user="app_user", old_password="Pass", new_password="NewSecurePass123!") | Updates user login password. |
| 51 | Drop User Account | utility.drop_user(user="app_user") | Deletes database user account. |
| 52 | List Users | utility.list_users() | Lists all registered database users. |
| 53 | Create Security Role | utility.create_role(role_name="analyst") | Provisions RBAC security role. |
| 54 | Drop Security Role | utility.drop_role(role_name="analyst") | Deletes RBAC security role. |
| 55 | Grant Role to User | utility.grant_role(user="app_user", role_name="analyst") | Assigns RBAC role to user. |
| 56 | Revoke Role from User | utility.revoke_role(user="app_user", role_name="analyst") | Revokes RBAC role from user. |
| 57 | Grant Privilege to Role | utility.grant_privilege(role_name="analyst", object_type="Collection", privilege="Search", object_name="enterprise_embeddings") | Grants search access on collection. |
| 58 | Revoke Privilege from Role | utility.revoke_privilege(role_name="analyst", object_type="Collection", privilege="Search", object_name="enterprise_embeddings") | Revokes search access on collection. |
| 59 | List Roles | utility.list_roles() | Lists all registered security roles. |
| 60 | Select Role Privileges | utility.select_role(role_name="analyst", include_userInfo=True) | Inspects permissions assigned to role. |
| 61 | Create Database | from pymilvus import db; db.create_database("tenant_db") | Provisions multi-tenant database container. |
| 62 | Drop Database | db.drop_database("tenant_db") | Deletes database container. |
| 63 | List Databases | db.list_database() | Lists all database containers in Milvus cluster. |
| 64 | Switch Database | db.using_database("tenant_db") | Switches active database context. |
| 65 | Bulk Import Data (S3/MinIO) | from pymilvus import bulk_writer; # Submit bulk ingestion task from cloud files | Bulk loads Parquet/JSON files into collection. |
| 66 | Get Bulk Import State | utility.get_import_state(task_id=12345) | Monitors bulk ingestion job progress. |
| 67 | List Bulk Import Tasks | utility.list_import_tasks() | Lists active and completed bulk import jobs. |
| 68 | Check Query Segment Information | utility.get_query_segment_info("enterprise_embeddings") | Inspects segment distribution across query nodes. |
| 69 | Check Persistent Segment Information | utility.get_persistent_segment_info("enterprise_embeddings") | Inspects persistent segment files on object storage. |
| 70 | Check Replicas Distribution | col.get_replicas() | Inspects collection in-memory replica nodes distribution. |
| 71 | Update Collection Replicas | col.restore() | Restores collection in-memory state. |
| 72 | Create Collection Index Async | col.create_index("vector", index_params, _async=True) | Starts non-blocking background index construction. |
| 73 | Check Collection Loading State | utility.get_loading_progress("enterprise_embeddings") | Monitors collection RAM loading progress. |
| 74 | Check Milvus Version | utility.get_server_version() | Outputs Milvus server binary version string. |
| 75 | Check Milvus Connection List | connections.list_connections() | Lists active PyMilvus connection aliases. |
| 76 | Check Milvus Connection Status | connections.get_connection_addr("default") | Pulls host and port for active connection. |
| 77 | Check Metrics HTTP Prometheus | curl http://localhost:9091/metrics | grep milvus | Queries Prometheus metrics endpoint. |
| 78 | Check Health Readiness REST API | curl http://localhost:9091/healthz | Queries HTTP readiness endpoint. |
| 79 | Check Health Liveness REST API | curl http://localhost:9091/healthz/liveness | Queries HTTP liveness endpoint. |
| 80 | Check System Configuration | utility.get_server_config() | Pulls active server configuration parameters. |
| 81 | Set Client Timeout | connections.connect("default", host="localhost", port="19530", timeout=10.0) | Sets 10-second socket RPC timeout. |
| 82 | Flush Specific Segments | utility.flush(["enterprise_embeddings"]) | Flushes buffer segments to object storage. |
| 83 | Clean Collection Garbage | utility.do_garbage_collection() | Triggers immediate background storage garbage collection. |
| 84 | Check Index Type Supported | utility.get_index_build_progress("enterprise_embeddings", "") | Inspects index build completion status. |
| 85 | Check Disk Usage per Collection | utility.get_collection_stats("enterprise_embeddings") | Pulls physical disk bytes used by collection. |
| 86 | Search with Consistency Level | col.search(data, "vector", search_params, limit=10, consistency_level="Bounded") | Configures consistency level (Strong, Bounded, Eventually). |
| 87 | Query with Consistency Level | col.query(expr="id > 0", consistency_level="Strong") | Executes query with Strong read consistency. |
| 88 | Create Sparse Vector Field | schema.add_field("sparse_vector", DataType.SPARSE_FLOAT_VECTOR) | Adds sparse vector field for BM25 keyword search. |
| 89 | Create Sparse Index | index_params = {"metric_type": "IP", "index_type": "SPARSE_INVERTED_INDEX"}; col.create_index("sparse_vector", index_params) | Provisions inverted index for sparse vectors. |
| 90 | Search Sparse Vectors | col.search(data=[{1: 0.5, 10: 0.8}], anns_field="sparse_vector", param=search_params, limit=10) | Executes sparse vector keyword search. |
| 91 | Search Multi-Vector Hybrid | # Execute AnnSearchRequest multi-vector hybrid search | Combines dense and sparse vector search queries. |
| 92 | Get Partition Statistics | col.partition("us_region").num_entities | Calculates total vector count in partition. |
| 93 | Query Partition Entities | col.query(expr="id > 0", partition_names=["us_region"]) | Queries vectors within specific partition. |
| 94 | Delete Partition Entities | col.delete(expr="id > 0", partition_name="us_region") | Deletes vectors within specific partition. |
| 95 | Check Active Server Nodes | utility.list_node_info() | Inspects proxy, query node, and data node health. |
| 96 | Close All Connections | connections.disconnect_all() | Disconnects all active PyMilvus client connections. |
| 97 | Verify Milvus Client Ready | connections.has_connection("default") | Verifies whether named connection alias is connected. |
| 98 | Check Milvus Component Status | curl http://localhost:9091/api/v1/health | Queries REST health API for component statuses. |
| 99 | Check System Config Parameters | utility.get_server_config() | Inspects server configuration properties. |
| 100 | Check Connection Network Address | connections.get_connection_addr('default') | Pulls host address for default connection. |
| 101 | Connect to Milvus Client Option 1 | from pymilvus import connections; connections.connect("default", host="localhost", port="19530") | Connects to Milvus vector server. |
| 102 | Create Collection Option 2 | from pymilvus import Collection, FieldSchema, CollectionSchema, DataType; schema = CollectionSchema([FieldSchema("id", DataType.INT64, is_primary=True), FieldSchema("vector", DataType.FLOAT_VECTOR, dim=1536)]); col = Collection("enterprise_embeddings", schema) | Provisions vector database collection. |
| 103 | Drop Collection Option 3 | col.drop() | Deletes vector collection. |
| 104 | List Collections Option 4 | from pymilvus import utility; utility.list_collections() | Outputs all vector collections. |
| 105 | Insert Vectors Option 5 | data = [[1, 2], [[0.1, ...], [0.2, ...]]]; col.insert(data) | Writes vector embeddings into collection. |
| 106 | Flush Collection Option 6 | col.flush() | Flushes inserted vectors to persistent storage. |
| 107 | Create Vector Index Option 7 | index_params = {"metric_type": "L2", "index_type": "IVF_FLAT", "params": {"nlist": 1024}}; col.create_index("vector", index_params) | Provisions high-speed vector similarity index. |
| 108 | Drop Vector Index Option 8 | col.drop_index() | Removes vector index. |
| 109 | Load Collection into Memory Option 9 | col.load() | Loads vector index into RAM for searching. |
| 110 | Release Collection from Memory Option 10 | col.release() | Unloads vector collection from RAM. |
| 111 | Execute Vector Similarity Search Option 11 | search_params = {"metric_type": "L2", "params": {"nprobe": 10}}; results = col.search([[0.1, ...]], "vector", search_params, limit=5) | Executes nearest-neighbor vector search. |
| 112 | Query Entities by Filter Option 12 | col.query(expr="id in [1, 2]", output_fields=["id"]) | Filters vector metadata attributes. |
| 113 | Delete Entities Option 13 | col.delete(expr="id in [1]") | Removes vector records from collection. |
| 114 | Check Collection Statistics Option 14 | col.num_entities | Calculates total vector count. |
| 115 | Check Server Health Option 15 | from pymilvus import utility; utility.get_server_version() | Verifies Milvus server software version. |
| 116 | Create Partition Option 16 | col.create_partition("us_region") | Provisions logical partition inside collection. |
| 117 | Drop Partition Option 17 | col.drop_partition("us_region") | Removes collection partition. |
| 118 | List Partitions Option 18 | col.partitions | Outputs all collection partitions. |
| 119 | Load Partitions Option 19 | col.load(partition_names=["us_region"]) | Loads specific partition into RAM. |
| 120 | Create Alias Option 20 | from pymilvus import utility; utility.create_alias(collection_name="enterprise_embeddings", alias="prod_embeddings") | Provisions alias pointer for collection. |
| 121 | Drop Alias Option 21 | utility.drop_alias("prod_embeddings") | Removes collection alias. |
| 122 | List Aliases Option 22 | utility.list_aliases("enterprise_embeddings") | Outputs aliases for collection. |
| 123 | Compact Collection Storage Option 23 | col.compact() | Defragments vector segment storage. |
| 124 | Check Compaction Status Option 24 | col.get_compaction_state() | Inspects vector segment compaction progress. |
| 125 | Get Collection Description Option 25 | col.describe() | Outputs detailed collection metadata. |
| 126 | Create User Role Option 26 | from pymilvus import ADMIN_USER; # Managed via REST/RBAC API | Provisions Milvus security role. |
| 127 | Export Metrics (Prometheus) Option 27 | curl http://localhost:9091/metrics | Pulls Milvus server telemetry metrics. |
| 128 | Check Proxy Status Option 28 | curl http://localhost:9091/healthz | Verifies proxy node health state. |
| 129 | Run Hybrid Search (BM25 + Vector) Option 29 | # Execute hybrid sparse-dense vector search query | Performs multi-modal AI search. |
| 130 | Disconnect Client Option 30 | connections.disconnect("default") | Closes connection to Milvus server. |
| 131 | Check Has Collection Option 31 | utility.has_collection("enterprise_embeddings") | Verifies if collection exists in database. |
| 132 | Check Has Partition Option 32 | col.has_partition("us_region") | Verifies if partition exists in collection. |
| 133 | Release Partition Option 33 | col.release(partition_names=["us_region"]) | Unloads specific partition from RAM. |
| 134 | Alter Collection Properties Option 34 | col.set_properties({"collection.ttl.seconds": 86400}) | Configures 24-hour collection-level TTL. |
| 135 | Create HNSW Index Option 35 | index_params = {"metric_type": "COSINE", "index_type": "HNSW", "params": {"M": 16, "efConstruction": 200}}; col.create_index("vector", index_params) | Provisions HNSW graph vector index. |
| 136 | Create DISKANN Index Option 36 | index_params = {"metric_type": "L2", "index_type": "DISKANN", "params": {"search_list": 32}}; col.create_index("vector", index_params) | Provisions disk-backed DiskANN vector index. |
| 137 | Create FLAT Index Option 37 | index_params = {"metric_type": "IP", "index_type": "FLAT", "params": {}}; col.create_index("vector", index_params) | Provisions exact brute-force FLAT vector index. |
| 138 | Create AUTOINDEX Option 38 | index_params = {"metric_type": "COSINE", "index_type": "AUTOINDEX", "params": {}}; col.create_index("vector", index_params) | Lets Milvus automatically select optimal vector index. |
| 139 | Create Scalar Index Option 39 | col.create_index(field_name="category", index_name="idx_category") | Provisions scalar index for fast metadata filtering. |
| 140 | Drop Scalar Index Option 40 | col.drop_index(index_name="idx_category") | Removes scalar index. |
| 141 | Check Index Progress Option 41 | utility.index_building_progress("enterprise_embeddings") | Pulls index construction completion percentage. |
| 142 | Check Load State Option 42 | utility.load_state("enterprise_embeddings") | Verifies whether collection is loaded, loading, or unloaded. |
| 143 | Check Loading Progress Option 43 | utility.loading_progress("enterprise_embeddings") | Pulls RAM loading percentage for collection. |
| 144 | Upsert Vectors Option 44 | col.upsert(data) | Inserts or updates vector entities by primary key. |
| 145 | Search with Output Fields Option 45 | col.search(data=[[0.1, ...]], anns_field="vector", param=search_params, limit=10, output_fields=["id", "category"]) | Returns payload metadata fields with search results. |
| 146 | Search with Range Filter Option 46 | col.search(data=[[0.1, ...]], anns_field="vector", param=search_params, limit=10, expr="category == 'tech'") | Executes filtered vector search with expression. |
| 147 | Search with Radius Range Option 47 | search_params = {"metric_type": "L2", "params": {"radius": 0.5, "range_filter": 0.2}}; col.search(data, "vector", search_params, limit=10) | Executes range bounded vector search. |
| 148 | Search with Grouping Option 48 | col.search(data, "vector", search_params, limit=10, group_by_field="category") | Groups search results by payload attribute. |
| 149 | Create User Account Option 49 | utility.create_user(user="app_user", password="SecurePass123!") | Provisions database user account. |
| 150 | Update User Password Option 50 | utility.update_password(user="app_user", old_password="Pass", new_password="NewSecurePass123!") | Updates user login password. |
| 151 | Drop User Account Option 51 | utility.drop_user(user="app_user") | Deletes database user account. |
| 152 | List Users Option 52 | utility.list_users() | Lists all registered database users. |
| 153 | Create Security Role Option 53 | utility.create_role(role_name="analyst") | Provisions RBAC security role. |
| 154 | Drop Security Role Option 54 | utility.drop_role(role_name="analyst") | Deletes RBAC security role. |
| 155 | Grant Role to User Option 55 | utility.grant_role(user="app_user", role_name="analyst") | Assigns RBAC role to user. |
| 156 | Revoke Role from User Option 56 | utility.revoke_role(user="app_user", role_name="analyst") | Revokes RBAC role from user. |
| 157 | Grant Privilege to Role Option 57 | utility.grant_privilege(role_name="analyst", object_type="Collection", privilege="Search", object_name="enterprise_embeddings") | Grants search access on collection. |
| 158 | Revoke Privilege from Role Option 58 | utility.revoke_privilege(role_name="analyst", object_type="Collection", privilege="Search", object_name="enterprise_embeddings") | Revokes search access on collection. |
| 159 | List Roles Option 59 | utility.list_roles() | Lists all registered security roles. |
| 160 | Select Role Privileges Option 60 | utility.select_role(role_name="analyst", include_userInfo=True) | Inspects permissions assigned to role. |
| 161 | Create Database Option 61 | from pymilvus import db; db.create_database("tenant_db") | Provisions multi-tenant database container. |
| 162 | Drop Database Option 62 | db.drop_database("tenant_db") | Deletes database container. |
| 163 | List Databases Option 63 | db.list_database() | Lists all database containers in Milvus cluster. |
| 164 | Switch Database Option 64 | db.using_database("tenant_db") | Switches active database context. |
| 165 | Bulk Import Data (S3/MinIO) Option 65 | from pymilvus import bulk_writer; # Submit bulk ingestion task from cloud files | Bulk loads Parquet/JSON files into collection. |
| 166 | Get Bulk Import State Option 66 | utility.get_import_state(task_id=12345) | Monitors bulk ingestion job progress. |
| 167 | List Bulk Import Tasks Option 67 | utility.list_import_tasks() | Lists active and completed bulk import jobs. |
| 168 | Check Query Segment Information Option 68 | utility.get_query_segment_info("enterprise_embeddings") | Inspects segment distribution across query nodes. |
| 169 | Check Persistent Segment Information Option 69 | utility.get_persistent_segment_info("enterprise_embeddings") | Inspects persistent segment files on object storage. |
| 170 | Check Replicas Distribution Option 70 | col.get_replicas() | Inspects collection in-memory replica nodes distribution. |
| 171 | Update Collection Replicas Option 71 | col.restore() | Restores collection in-memory state. |
| 172 | Create Collection Index Async Option 72 | col.create_index("vector", index_params, _async=True) | Starts non-blocking background index construction. |
| 173 | Check Collection Loading State Option 73 | utility.get_loading_progress("enterprise_embeddings") | Monitors collection RAM loading progress. |
| 174 | Check Milvus Version Option 74 | utility.get_server_version() | Outputs Milvus server binary version string. |
| 175 | Check Milvus Connection List Option 75 | connections.list_connections() | Lists active PyMilvus connection aliases. |
| 176 | Check Milvus Connection Status Option 76 | connections.get_connection_addr("default") | Pulls host and port for active connection. |
| 177 | Check Metrics HTTP Prometheus Option 77 | curl http://localhost:9091/metrics | grep milvus | Queries Prometheus metrics endpoint. |
| 178 | Check Health Readiness REST API Option 78 | curl http://localhost:9091/healthz | Queries HTTP readiness endpoint. |
| 179 | Check Health Liveness REST API Option 79 | curl http://localhost:9091/healthz/liveness | Queries HTTP liveness endpoint. |
| 180 | Check System Configuration Option 80 | utility.get_server_config() | Pulls active server configuration parameters. |
| 181 | Set Client Timeout Option 81 | connections.connect("default", host="localhost", port="19530", timeout=10.0) | Sets 10-second socket RPC timeout. |
| 182 | Flush Specific Segments Option 82 | utility.flush(["enterprise_embeddings"]) | Flushes buffer segments to object storage. |
| 183 | Clean Collection Garbage Option 83 | utility.do_garbage_collection() | Triggers immediate background storage garbage collection. |
| 184 | Check Index Type Supported Option 84 | utility.get_index_build_progress("enterprise_embeddings", "") | Inspects index build completion status. |
| 185 | Check Disk Usage per Collection Option 85 | utility.get_collection_stats("enterprise_embeddings") | Pulls physical disk bytes used by collection. |
| 186 | Search with Consistency Level Option 86 | col.search(data, "vector", search_params, limit=10, consistency_level="Bounded") | Configures consistency level (Strong, Bounded, Eventually). |
| 187 | Query with Consistency Level Option 87 | col.query(expr="id > 0", consistency_level="Strong") | Executes query with Strong read consistency. |
| 188 | Create Sparse Vector Field Option 88 | schema.add_field("sparse_vector", DataType.SPARSE_FLOAT_VECTOR) | Adds sparse vector field for BM25 keyword search. |
| 189 | Create Sparse Index Option 89 | index_params = {"metric_type": "IP", "index_type": "SPARSE_INVERTED_INDEX"}; col.create_index("sparse_vector", index_params) | Provisions inverted index for sparse vectors. |
| 190 | Search Sparse Vectors Option 90 | col.search(data=[{1: 0.5, 10: 0.8}], anns_field="sparse_vector", param=search_params, limit=10) | Executes sparse vector keyword search. |
| 191 | Search Multi-Vector Hybrid Option 91 | # Execute AnnSearchRequest multi-vector hybrid search | Combines dense and sparse vector search queries. |
| 192 | Get Partition Statistics Option 92 | col.partition("us_region").num_entities | Calculates total vector count in partition. |
| 193 | Query Partition Entities Option 93 | col.query(expr="id > 0", partition_names=["us_region"]) | Queries vectors within specific partition. |
| 194 | Delete Partition Entities Option 94 | col.delete(expr="id > 0", partition_name="us_region") | Deletes vectors within specific partition. |
| 195 | Check Active Server Nodes Option 95 | utility.list_node_info() | Inspects proxy, query node, and data node health. |
| 196 | Close All Connections Option 96 | connections.disconnect_all() | Disconnects all active PyMilvus client connections. |
| 197 | Verify Milvus Client Ready Option 97 | connections.has_connection("default") | Verifies whether named connection alias is connected. |
| 198 | Check Milvus Component Status Option 98 | curl http://localhost:9091/api/v1/health | Queries REST health API for component statuses. |
| 199 | Check System Config Parameters Option 99 | utility.get_server_config() | Inspects server configuration properties. |
| 200 | Check Connection Network Address Option 100 | connections.get_connection_addr('default') | Pulls host address for default connection. |
Qdrant Vector DB VECTOR
Technical Architecture & Overview
Qdrant Vector DB is a high-performance vector search engine written in Rust. It provides fast nearest-neighbor search with rich payload metadata filtering, supporting advanced vector quantization (Scalar & Product Quantization), sparse-dense hybrid vectors, multi-vector collections, and distributed sharding via Raft consensus.
Primary Use Cases: RAG context retrieval for AI agents, semantic search engines, automated multi-modal recommendations, anomaly detection, and image/document embedding matching.
Core Components: Rust Vector Engine, HNSW Graph Indexer, Payload Filter Engine, Quantization Engine (Scalar/PQ), Raft Distributed Consensus, and REST / gRPC API.
Exhaustive 200-command administrative, diagnostic, and operational matrix for Qdrant Vector DB.
| # | Operation / Action | Qdrant Python / REST Syntax | Description |
|---|---|---|---|
| 1 | Connect to Qdrant Client | from qdrant_client import QdrantClient; client = QdrantClient(url="http://localhost:6333") | Connects to Qdrant vector database. |
| 2 | Check Server Health | client.get_telemetry() | Verifies Qdrant server health state. |
| 3 | Create Collection | from qdrant_client.http import models; client.create_collection(collection_name="enterprise_vectors", vectors_config=models.VectorParams(size=1536, distance=models.Distance.COSINE)) | Provisions vector collection. |
| 4 | Delete Collection | client.delete_collection(collection_name="enterprise_vectors") | Deletes vector collection. |
| 5 | List Collections | client.get_collections() | Outputs all vector collections. |
| 6 | Get Collection Info | client.get_collection(collection_name="enterprise_vectors") | Inspects vector count and index status. |
| 7 | Upsert Vectors | client.upsert(collection_name="enterprise_vectors", points=[models.PointStruct(id=1, vector=[0.1, ...], payload={"category": "tech"})]) | Writes vector embeddings and metadata payload. |
| 8 | Retrieve Points by ID | client.retrieve(collection_name="enterprise_vectors", ids=[1]) | Fetches vectors by ID. |
| 9 | Delete Points | client.delete(collection_name="enterprise_vectors", points_selector=models.PointIdsList(points=[1])) | Removes vector points. |
| 10 | Execute Vector Similarity Search | client.search(collection_name="enterprise_vectors", query_vector=[0.1, ...], limit=5) | Executes nearest-neighbor vector search. |
| 11 | Search with Payload Filter | client.search(collection_name="enterprise_vectors", query_vector=[0.1, ...], query_filter=models.Filter(must=[models.FieldCondition(key="category", match=models.MatchValue(value="tech"))]), limit=5) | Executes filtered vector search. |
| 12 | Create Payload Index | client.create_payload_index(collection_name="enterprise_vectors", field_name="category", field_schema=models.PayloadSchemaType.KEYWORD) | Provisions metadata filter index. |
| 13 | Delete Payload Index | client.delete_payload_index(collection_name="enterprise_vectors", field_name="category") | Removes metadata filter index. |
| 14 | Create Snapshot | client.create_snapshot(collection_name="enterprise_vectors") | Takes collection storage snapshot. |
| 15 | List Snapshots | client.list_snapshots(collection_name="enterprise_vectors") | Outputs all collection snapshots. |
| 16 | Recover from Snapshot | client.recover_snapshot(collection_name="enterprise_vectors", snapshot_name="snapshot_file.snapshot") | Restores collection from snapshot. |
| 17 | Create Quantization (Compression) | client.update_collection(collection_name="enterprise_vectors", quantization_config=models.ScalarQuantization(scalar=models.ScalarQuantizationConfig(type=models.ScalarType.INT8))) | Enforces scalar vector quantization for memory reduction. |
| 18 | Create Alias | client.update_collection_aliases(actions=[models.CreateAliasOperation(alias_name="prod_vectors", collection_name="enterprise_vectors")]) | Provisions alias pointer for collection. |
| 19 | Delete Alias | client.update_collection_aliases(actions=[models.DeleteAliasOperation(alias_name="prod_vectors")]) | Removes collection alias. |
| 20 | List Aliases | client.get_collection_aliases(collection_name="enterprise_vectors") | Outputs aliases for collection. |
| 21 | Scroll Through Points | client.scroll(collection_name="enterprise_vectors", limit=100) | Paginates through vector collection records. |
| 22 | Count Points | client.count(collection_name="enterprise_vectors", exact=True) | Calculates exact vector point count. |
| 23 | Recommend Vectors | client.recommend(collection_name="enterprise_vectors", positive=[1], negative=[2], limit=5) | Recommends vectors based on positive/negative examples. |
| 24 | Discover Vectors | client.discover(collection_name="enterprise_vectors", target=[0.1, ...], context=[models.ContextExample(positive=[1], negative=[2])]) | Discovers vectors based on contextual intent. |
| 25 | Cluster Points | client.cluster(collection_name="enterprise_vectors") | Inspects distributed cluster shard topology. |
| 26 | Update Point Payload | client.set_payload(collection_name="enterprise_vectors", payload={"status": "active"}, points=[1]) | Modifies metadata payload. |
| 27 | Clear Payload | client.clear_payload(collection_name="enterprise_vectors", points_selector=models.PointIdsList(points=[1])) | Removes metadata payload fields. |
| 28 | Export Metrics (Prometheus) | curl http://localhost:6333/metrics | Pulls Qdrant server telemetry metrics. |
| 29 | Check Cluster Consensus | client.print_locks() | Inspects distributed consensus raft locks. |
| 30 | Close Client Connection | client.close() | Closes connection to Qdrant server. |
| 31 | Check Has Collection | client.collection_exists(collection_name="enterprise_vectors") | Verifies whether vector collection exists. |
| 32 | Create Multi-Vector Collection | client.create_collection(collection_name="multi_vectors", vectors_config={"text": models.VectorParams(size=1536, distance=models.Distance.COSINE), "image": models.VectorParams(size=512, distance=models.Distance.EUCLID)}) | Provisions collection with multiple named vector fields. |
| 33 | Upsert Multi-Vectors | client.upsert(collection_name="multi_vectors", points=[models.PointStruct(id=1, vector={"text": [0.1, ...], "image": [0.2, ...]})]) | Writes named multi-vector point. |
| 34 | Search Named Vector | client.search(collection_name="multi_vectors", query_vector=("text", [0.1, ...]), limit=5) | Executes search on specific named vector field. |
| 35 | Create Sparse Vector Collection | client.create_collection(collection_name="sparse_vectors", sparse_vectors_config={"bm25": models.SparseVectorParams()}) | Provisions collection supporting sparse vectors. |
| 36 | Upsert Sparse Vectors | client.upsert(collection_name="sparse_vectors", points=[models.PointStruct(id=1, vector={"bm25": models.SparseVector(indices=[1, 12, 45], values=[0.1, 0.8, 0.3])})]) | Writes sparse vector keyword embeddings. |
| 37 | Search Sparse Vector | client.search(collection_name="sparse_vectors", query_vector=models.NamedSparseVector(name="bm25", vector=models.SparseVector(indices=[1], values=[1.0])), limit=5) | Executes sparse vector search query. |
| 38 | Query Search Batch | client.search_batch(collection_name="enterprise_vectors", requests=[models.SearchRequest(vector=[0.1, ...], limit=5), models.SearchRequest(vector=[0.2, ...], limit=5)]) | Executes multiple vector searches in single RPC roundtrip. |
| 39 | Recommend Batch | client.recommend_batch(collection_name="enterprise_vectors", requests=[models.RecommendRequest(positive=[1], limit=5)]) | Executes multiple recommendation queries in batch. |
| 40 | Delete Snapshot File | client.delete_snapshot(collection_name="enterprise_vectors", snapshot_name="snapshot_file.snapshot") | Deletes snapshot file from storage. |
| 41 | Create Full System Snapshot | client.create_full_snapshot() | Takes snapshot of all collections and cluster state. |
| 42 | List Full System Snapshots | client.list_full_snapshots() | Lists all system-wide snapshots. |
| 43 | Delete Full System Snapshot | client.delete_full_snapshot(snapshot_name="full_snap.snapshot") | Deletes system-wide snapshot. |
| 44 | Create Integer Payload Index | client.create_payload_index(collection_name="enterprise_vectors", field_name="age", field_schema=models.PayloadSchemaType.INTEGER) | Provisions integer filter index. |
| 45 | Create Float Payload Index | client.create_payload_index(collection_name="enterprise_vectors", field_name="score", field_schema=models.PayloadSchemaType.FLOAT) | Provisions float filter index. |
| 46 | Create Geo Payload Index | client.create_payload_index(collection_name="enterprise_vectors", field_name="loc", field_schema=models.PayloadSchemaType.GEO) | Provisions geospatial filter index. |
| 47 | Create Text Payload Index | client.create_payload_index(collection_name="enterprise_vectors", field_name="description", field_schema=models.TextIndexParams(type="text", tokenizer=models.TokenizerType.WORD)) | Provisions fulltext payload filter index. |
| 48 | Search Geo Bounding Box | client.search(collection_name="enterprise_vectors", query_vector=[0.1, ...], query_filter=models.Filter(must=[models.FieldCondition(key="loc", geo_bounding_box=models.GeoBoundingBox(top_left=models.GeoPoint(lon=-74.0, lat=40.8), bottom_right=models.GeoPoint(lon=-73.8, lat=40.7)))])) | Filters search results within spatial bounding box. |
| 49 | Search Geo Radius | client.search(collection_name="enterprise_vectors", query_vector=[0.1, ...], query_filter=models.Filter(must=[models.FieldCondition(key="loc", geo_radius=models.GeoRadius(center=models.GeoPoint(lon=-73.9, lat=40.7), radius=5000.0))])) | Filters search results within 5km radius. |
| 50 | Search Range Filter | client.search(collection_name="enterprise_vectors", query_vector=[0.1, ...], query_filter=models.Filter(must=[models.FieldCondition(key="age", range=models.Range(gte=18, lte=65))])) | Filters search results within numeric range. |
| 51 | Search Match Any Filter | client.search(collection_name="enterprise_vectors", query_vector=[0.1, ...], query_filter=models.Filter(must=[models.FieldCondition(key="category", match=models.MatchAny(any=["tech", "finance"]))])) | Filters search results matching array of values. |
| 52 | Search Is Null Filter | client.search(collection_name="enterprise_vectors", query_vector=[0.1, ...], query_filter=models.Filter(must_not=[models.IsEmptyCondition(is_empty=models.PayloadField(key="category"))])) | Filters out vectors where payload field is empty. |
| 53 | Delete Payload Field | client.delete_payload(collection_name="enterprise_vectors", keys=["status"], points=[1]) | Removes specific keys from metadata payload. |
| 54 | Overwrite Payload | client.overwrite_payload(collection_name="enterprise_vectors", payload={"role": "admin"}, points=[1]) | Replaces entire metadata payload for point. |
| 55 | Check Sharding Optimizer Config | client.update_collection(collection_name="enterprise_vectors", optimizer_config=models.OptimizersConfigDiff(indexing_threshold=20000)) | Configures HNSW indexing threshold. |
| 56 | Check HNSW Config Update | client.update_collection(collection_name="enterprise_vectors", hnsw_config=models.HnswConfigDiff(m=32, ef_construct=200)) | Updates graph HNSW parameters on live collection. |
| 57 | Enable Product Quantization | client.update_collection(collection_name="enterprise_vectors", quantization_config=models.ProductQuantization(product=models.ProductQuantizationConfig(compression=models.CompressionRatio.X16))) | Enforces 16x product quantization for memory reduction. |
| 58 | Disable Quantization | client.update_collection(collection_name="enterprise_vectors", quantization_config=models.Disabled()) | Disables vector quantization. |
| 59 | Update Collection Params | client.update_collection(collection_name="enterprise_vectors", params=models.CollectionParamsDiff(replication_factor=2)) | Updates replication factor across cluster. |
| 60 | Check Cluster Peer List | client.get_cluster_info() | Inspects active cluster peer nodes and consensus state. |
| 61 | Recover Shard Peer | client.recover_shard(collection_name="enterprise_vectors", shard_id=0, peer_id=1) | Triggers shard recovery on peer node. |
| 62 | Drop Shard Replica | client.delete_shard_key(collection_name="enterprise_vectors", shard_key="tenant_a") | Deletes custom shard key partition. |
| 63 | Create Custom Shard Key | client.create_shard_key(collection_name="enterprise_vectors", shard_key="tenant_a") | Provisions custom shard key for tenant isolation. |
| 64 | Upsert Point with Shard Key | client.upsert(collection_name="enterprise_vectors", points=[...], shard_key_selector="tenant_a") | Writes vector point to custom tenant shard. |
| 65 | Search Point with Shard Key | client.search(collection_name="enterprise_vectors", query_vector=[0.1, ...], shard_key_selector="tenant_a") | Searches vectors within custom tenant shard. |
| 66 | Count Points with Shard Key | client.count(collection_name="enterprise_vectors", shard_key_selector="tenant_a") | Calculates point count in tenant shard. |
| 67 | Scroll Points with Shard Key | client.scroll(collection_name="enterprise_vectors", shard_key_selector="tenant_a") | Paginates records in tenant shard. |
| 68 | Delete Points with Shard Key | client.delete(collection_name="enterprise_vectors", points_selector=..., shard_key_selector="tenant_a") | Deletes records in tenant shard. |
| 69 | Search Groups (Field Grouping) | client.search_groups(collection_name="enterprise_vectors", query_vector=[0.1, ...], group_by="document_id", group_size=3, limit=10) | Groups vector search results by document ID. |
| 70 | Recommend Groups | client.recommend_groups(collection_name="enterprise_vectors", positive=[1], group_by="document_id", group_size=3, limit=10) | Groups recommendation results by document ID. |
| 71 | Query Points Universal API | client.query_points(collection_name="enterprise_vectors", query=[0.1, ...], limit=5) | Executes universal query API in Qdrant 1.7+. |
| 72 | Query Points Nearest Neighbor | client.query_points(collection_name="enterprise_vectors", query=models.NearestQuery(nearest=[0.1, ...]), limit=5) | Queries nearest neighbors via Universal API. |
| 73 | Query Points Fusion RRF | client.query_points(collection_name="enterprise_vectors", query=models.FusionQuery(fusion=models.Fusion.RRF), limit=5) | Executes Reciprocal Rank Fusion on search results. |
| 74 | Query Points Sample | client.query_points(collection_name="enterprise_vectors", query=models.SampleQuery(sample=models.Sample.RANDOM), limit=5) | Returns random sample of points. |
| 75 | Check Server Lock Status | client.get_locks() | Inspects current write locks on server. |
| 76 | Set Server Write Lock | client.post_locks(has_write_locks=True, error_message="Maintenance mode") | Enforces global read-only lock. |
| 77 | Clear Server Write Lock | client.post_locks(has_write_locks=False) | Clears global read-only lock. |
| 78 | Check Health Probe REST API | curl http://localhost:6333/healthz | Queries HTTP REST endpoint for server health. |
| 79 | Check Readiness Probe REST API | curl http://localhost:6333/readyz | Queries HTTP REST endpoint for server readiness probe. |
| 80 | Check OpenAPI Schema REST API | curl http://localhost:6333/api-data | Fetches JSON OpenAPI specification schema. |
| 81 | Check Telemetry REST API | curl http://localhost:6333/telemetry | Pulls server telemetry diagnostics. |
| 82 | Check Qdrant Client Version | import qdrant_client; print(qdrant_client.__version__) | Outputs Qdrant Python client library version string. |
| 83 | Verify API Key Authentication | QdrantClient(url="http://localhost:6333", api_key="pc_secure_key") | Authenticates Qdrant client via API key header. |
| 84 | Set Client Timeout | QdrantClient(url="http://localhost:6333", timeout=30.0) | Sets 30-second gRPC/REST socket timeout. |
| 85 | Close gRPC Client Channels | client.close() | Gracefully closes gRPC network channels to Qdrant server. |
| 86 | Check Collection Optimizer Status | client.get_collection(collection_name='enterprise_vectors').optimizer_status | Inspects collection background optimizer status. |
| 87 | Check Collection Payload Schema | client.get_collection(collection_name='enterprise_vectors').payload_schema | Inspects created payload indexes and schemas. |
| 88 | Check Collection Vectors Config | client.get_collection(collection_name='enterprise_vectors').config.params.vectors | Inspects vector dimension and metric configuration. |
| 89 | Check Collection Quantization Status | client.get_collection(collection_name='enterprise_vectors').config.quantization_config | Inspects quantization settings on collection. |
| 90 | Check Collection HNSW Config | client.get_collection(collection_name='enterprise_vectors').config.hnsw_config | Inspects HNSW graph construction parameters. |
| 91 | Check Collection Points Count Exact | client.count(collection_name='enterprise_vectors', exact=True).count | Calculates exact point count in collection. |
| 92 | Check Collection Points Count Fast | client.count(collection_name='enterprise_vectors', exact=False).count | Fetches fast approximate point count. |
| 93 | Check Cluster Peer Consensus Info | client.get_cluster_info().peer_id | Extracts local peer node ID in cluster. |
| 94 | Check Cluster Peer Consensus State | client.get_cluster_info().state | Inspects consensus state (Leader/Follower). |
| 95 | Check Cluster Total Peers Count | len(client.get_cluster_info().peers) | Calculates total peer nodes in cluster. |
| 96 | Check Collection Aliases Count | len(client.get_collection_aliases(collection_name='enterprise_vectors').aliases) | Calculates count of active aliases for collection. |
| 97 | Check Snapshots Count | len(client.list_snapshots(collection_name='enterprise_vectors')) | Calculates total saved snapshots for collection. |
| 98 | Check Full System Snapshots Count | len(client.list_full_snapshots()) | Calculates total saved system-wide snapshots. |
| 99 | Check Client User Agent Header | client.openapi_client.client.user_agent | Inspects client HTTP user agent header string. |
| 100 | Verify Qdrant REST Server Health | curl -s http://localhost:6333/healthz | Queries HTTP REST endpoint for server health. |
| 101 | Connect to Qdrant Client Option 1 | from qdrant_client import QdrantClient; client = QdrantClient(url="http://localhost:6333") | Connects to Qdrant vector database. |
| 102 | Check Server Health Option 2 | client.get_telemetry() | Verifies Qdrant server health state. |
| 103 | Create Collection Option 3 | from qdrant_client.http import models; client.create_collection(collection_name="enterprise_vectors", vectors_config=models.VectorParams(size=1536, distance=models.Distance.COSINE)) | Provisions vector collection. |
| 104 | Delete Collection Option 4 | client.delete_collection(collection_name="enterprise_vectors") | Deletes vector collection. |
| 105 | List Collections Option 5 | client.get_collections() | Outputs all vector collections. |
| 106 | Get Collection Info Option 6 | client.get_collection(collection_name="enterprise_vectors") | Inspects vector count and index status. |
| 107 | Upsert Vectors Option 7 | client.upsert(collection_name="enterprise_vectors", points=[models.PointStruct(id=1, vector=[0.1, ...], payload={"category": "tech"})]) | Writes vector embeddings and metadata payload. |
| 108 | Retrieve Points by ID Option 8 | client.retrieve(collection_name="enterprise_vectors", ids=[1]) | Fetches vectors by ID. |
| 109 | Delete Points Option 9 | client.delete(collection_name="enterprise_vectors", points_selector=models.PointIdsList(points=[1])) | Removes vector points. |
| 110 | Execute Vector Similarity Search Option 10 | client.search(collection_name="enterprise_vectors", query_vector=[0.1, ...], limit=5) | Executes nearest-neighbor vector search. |
| 111 | Search with Payload Filter Option 11 | client.search(collection_name="enterprise_vectors", query_vector=[0.1, ...], query_filter=models.Filter(must=[models.FieldCondition(key="category", match=models.MatchValue(value="tech"))]), limit=5) | Executes filtered vector search. |
| 112 | Create Payload Index Option 12 | client.create_payload_index(collection_name="enterprise_vectors", field_name="category", field_schema=models.PayloadSchemaType.KEYWORD) | Provisions metadata filter index. |
| 113 | Delete Payload Index Option 13 | client.delete_payload_index(collection_name="enterprise_vectors", field_name="category") | Removes metadata filter index. |
| 114 | Create Snapshot Option 14 | client.create_snapshot(collection_name="enterprise_vectors") | Takes collection storage snapshot. |
| 115 | List Snapshots Option 15 | client.list_snapshots(collection_name="enterprise_vectors") | Outputs all collection snapshots. |
| 116 | Recover from Snapshot Option 16 | client.recover_snapshot(collection_name="enterprise_vectors", snapshot_name="snapshot_file.snapshot") | Restores collection from snapshot. |
| 117 | Create Quantization (Compression) Option 17 | client.update_collection(collection_name="enterprise_vectors", quantization_config=models.ScalarQuantization(scalar=models.ScalarQuantizationConfig(type=models.ScalarType.INT8))) | Enforces scalar vector quantization for memory reduction. |
| 118 | Create Alias Option 18 | client.update_collection_aliases(actions=[models.CreateAliasOperation(alias_name="prod_vectors", collection_name="enterprise_vectors")]) | Provisions alias pointer for collection. |
| 119 | Delete Alias Option 19 | client.update_collection_aliases(actions=[models.DeleteAliasOperation(alias_name="prod_vectors")]) | Removes collection alias. |
| 120 | List Aliases Option 20 | client.get_collection_aliases(collection_name="enterprise_vectors") | Outputs aliases for collection. |
| 121 | Scroll Through Points Option 21 | client.scroll(collection_name="enterprise_vectors", limit=100) | Paginates through vector collection records. |
| 122 | Count Points Option 22 | client.count(collection_name="enterprise_vectors", exact=True) | Calculates exact vector point count. |
| 123 | Recommend Vectors Option 23 | client.recommend(collection_name="enterprise_vectors", positive=[1], negative=[2], limit=5) | Recommends vectors based on positive/negative examples. |
| 124 | Discover Vectors Option 24 | client.discover(collection_name="enterprise_vectors", target=[0.1, ...], context=[models.ContextExample(positive=[1], negative=[2])]) | Discovers vectors based on contextual intent. |
| 125 | Cluster Points Option 25 | client.cluster(collection_name="enterprise_vectors") | Inspects distributed cluster shard topology. |
| 126 | Update Point Payload Option 26 | client.set_payload(collection_name="enterprise_vectors", payload={"status": "active"}, points=[1]) | Modifies metadata payload. |
| 127 | Clear Payload Option 27 | client.clear_payload(collection_name="enterprise_vectors", points_selector=models.PointIdsList(points=[1])) | Removes metadata payload fields. |
| 128 | Export Metrics (Prometheus) Option 28 | curl http://localhost:6333/metrics | Pulls Qdrant server telemetry metrics. |
| 129 | Check Cluster Consensus Option 29 | client.print_locks() | Inspects distributed consensus raft locks. |
| 130 | Close Client Connection Option 30 | client.close() | Closes connection to Qdrant server. |
| 131 | Check Has Collection Option 31 | client.collection_exists(collection_name="enterprise_vectors") | Verifies whether vector collection exists. |
| 132 | Create Multi-Vector Collection Option 32 | client.create_collection(collection_name="multi_vectors", vectors_config={"text": models.VectorParams(size=1536, distance=models.Distance.COSINE), "image": models.VectorParams(size=512, distance=models.Distance.EUCLID)}) | Provisions collection with multiple named vector fields. |
| 133 | Upsert Multi-Vectors Option 33 | client.upsert(collection_name="multi_vectors", points=[models.PointStruct(id=1, vector={"text": [0.1, ...], "image": [0.2, ...]})]) | Writes named multi-vector point. |
| 134 | Search Named Vector Option 34 | client.search(collection_name="multi_vectors", query_vector=("text", [0.1, ...]), limit=5) | Executes search on specific named vector field. |
| 135 | Create Sparse Vector Collection Option 35 | client.create_collection(collection_name="sparse_vectors", sparse_vectors_config={"bm25": models.SparseVectorParams()}) | Provisions collection supporting sparse vectors. |
| 136 | Upsert Sparse Vectors Option 36 | client.upsert(collection_name="sparse_vectors", points=[models.PointStruct(id=1, vector={"bm25": models.SparseVector(indices=[1, 12, 45], values=[0.1, 0.8, 0.3])})]) | Writes sparse vector keyword embeddings. |
| 137 | Search Sparse Vector Option 37 | client.search(collection_name="sparse_vectors", query_vector=models.NamedSparseVector(name="bm25", vector=models.SparseVector(indices=[1], values=[1.0])), limit=5) | Executes sparse vector search query. |
| 138 | Query Search Batch Option 38 | client.search_batch(collection_name="enterprise_vectors", requests=[models.SearchRequest(vector=[0.1, ...], limit=5), models.SearchRequest(vector=[0.2, ...], limit=5)]) | Executes multiple vector searches in single RPC roundtrip. |
| 139 | Recommend Batch Option 39 | client.recommend_batch(collection_name="enterprise_vectors", requests=[models.RecommendRequest(positive=[1], limit=5)]) | Executes multiple recommendation queries in batch. |
| 140 | Delete Snapshot File Option 40 | client.delete_snapshot(collection_name="enterprise_vectors", snapshot_name="snapshot_file.snapshot") | Deletes snapshot file from storage. |
| 141 | Create Full System Snapshot Option 41 | client.create_full_snapshot() | Takes snapshot of all collections and cluster state. |
| 142 | List Full System Snapshots Option 42 | client.list_full_snapshots() | Lists all system-wide snapshots. |
| 143 | Delete Full System Snapshot Option 43 | client.delete_full_snapshot(snapshot_name="full_snap.snapshot") | Deletes system-wide snapshot. |
| 144 | Create Integer Payload Index Option 44 | client.create_payload_index(collection_name="enterprise_vectors", field_name="age", field_schema=models.PayloadSchemaType.INTEGER) | Provisions integer filter index. |
| 145 | Create Float Payload Index Option 45 | client.create_payload_index(collection_name="enterprise_vectors", field_name="score", field_schema=models.PayloadSchemaType.FLOAT) | Provisions float filter index. |
| 146 | Create Geo Payload Index Option 46 | client.create_payload_index(collection_name="enterprise_vectors", field_name="loc", field_schema=models.PayloadSchemaType.GEO) | Provisions geospatial filter index. |
| 147 | Create Text Payload Index Option 47 | client.create_payload_index(collection_name="enterprise_vectors", field_name="description", field_schema=models.TextIndexParams(type="text", tokenizer=models.TokenizerType.WORD)) | Provisions fulltext payload filter index. |
| 148 | Search Geo Bounding Box Option 48 | client.search(collection_name="enterprise_vectors", query_vector=[0.1, ...], query_filter=models.Filter(must=[models.FieldCondition(key="loc", geo_bounding_box=models.GeoBoundingBox(top_left=models.GeoPoint(lon=-74.0, lat=40.8), bottom_right=models.GeoPoint(lon=-73.8, lat=40.7)))])) | Filters search results within spatial bounding box. |
| 149 | Search Geo Radius Option 49 | client.search(collection_name="enterprise_vectors", query_vector=[0.1, ...], query_filter=models.Filter(must=[models.FieldCondition(key="loc", geo_radius=models.GeoRadius(center=models.GeoPoint(lon=-73.9, lat=40.7), radius=5000.0))])) | Filters search results within 5km radius. |
| 150 | Search Range Filter Option 50 | client.search(collection_name="enterprise_vectors", query_vector=[0.1, ...], query_filter=models.Filter(must=[models.FieldCondition(key="age", range=models.Range(gte=18, lte=65))])) | Filters search results within numeric range. |
| 151 | Search Match Any Filter Option 51 | client.search(collection_name="enterprise_vectors", query_vector=[0.1, ...], query_filter=models.Filter(must=[models.FieldCondition(key="category", match=models.MatchAny(any=["tech", "finance"]))])) | Filters search results matching array of values. |
| 152 | Search Is Null Filter Option 52 | client.search(collection_name="enterprise_vectors", query_vector=[0.1, ...], query_filter=models.Filter(must_not=[models.IsEmptyCondition(is_empty=models.PayloadField(key="category"))])) | Filters out vectors where payload field is empty. |
| 153 | Delete Payload Field Option 53 | client.delete_payload(collection_name="enterprise_vectors", keys=["status"], points=[1]) | Removes specific keys from metadata payload. |
| 154 | Overwrite Payload Option 54 | client.overwrite_payload(collection_name="enterprise_vectors", payload={"role": "admin"}, points=[1]) | Replaces entire metadata payload for point. |
| 155 | Check Sharding Optimizer Config Option 55 | client.update_collection(collection_name="enterprise_vectors", optimizer_config=models.OptimizersConfigDiff(indexing_threshold=20000)) | Configures HNSW indexing threshold. |
| 156 | Check HNSW Config Update Option 56 | client.update_collection(collection_name="enterprise_vectors", hnsw_config=models.HnswConfigDiff(m=32, ef_construct=200)) | Updates graph HNSW parameters on live collection. |
| 157 | Enable Product Quantization Option 57 | client.update_collection(collection_name="enterprise_vectors", quantization_config=models.ProductQuantization(product=models.ProductQuantizationConfig(compression=models.CompressionRatio.X16))) | Enforces 16x product quantization for memory reduction. |
| 158 | Disable Quantization Option 58 | client.update_collection(collection_name="enterprise_vectors", quantization_config=models.Disabled()) | Disables vector quantization. |
| 159 | Update Collection Params Option 59 | client.update_collection(collection_name="enterprise_vectors", params=models.CollectionParamsDiff(replication_factor=2)) | Updates replication factor across cluster. |
| 160 | Check Cluster Peer List Option 60 | client.get_cluster_info() | Inspects active cluster peer nodes and consensus state. |
| 161 | Recover Shard Peer Option 61 | client.recover_shard(collection_name="enterprise_vectors", shard_id=0, peer_id=1) | Triggers shard recovery on peer node. |
| 162 | Drop Shard Replica Option 62 | client.delete_shard_key(collection_name="enterprise_vectors", shard_key="tenant_a") | Deletes custom shard key partition. |
| 163 | Create Custom Shard Key Option 63 | client.create_shard_key(collection_name="enterprise_vectors", shard_key="tenant_a") | Provisions custom shard key for tenant isolation. |
| 164 | Upsert Point with Shard Key Option 64 | client.upsert(collection_name="enterprise_vectors", points=[...], shard_key_selector="tenant_a") | Writes vector point to custom tenant shard. |
| 165 | Search Point with Shard Key Option 65 | client.search(collection_name="enterprise_vectors", query_vector=[0.1, ...], shard_key_selector="tenant_a") | Searches vectors within custom tenant shard. |
| 166 | Count Points with Shard Key Option 66 | client.count(collection_name="enterprise_vectors", shard_key_selector="tenant_a") | Calculates point count in tenant shard. |
| 167 | Scroll Points with Shard Key Option 67 | client.scroll(collection_name="enterprise_vectors", shard_key_selector="tenant_a") | Paginates records in tenant shard. |
| 168 | Delete Points with Shard Key Option 68 | client.delete(collection_name="enterprise_vectors", points_selector=..., shard_key_selector="tenant_a") | Deletes records in tenant shard. |
| 169 | Search Groups (Field Grouping) Option 69 | client.search_groups(collection_name="enterprise_vectors", query_vector=[0.1, ...], group_by="document_id", group_size=3, limit=10) | Groups vector search results by document ID. |
| 170 | Recommend Groups Option 70 | client.recommend_groups(collection_name="enterprise_vectors", positive=[1], group_by="document_id", group_size=3, limit=10) | Groups recommendation results by document ID. |
| 171 | Query Points Universal API Option 71 | client.query_points(collection_name="enterprise_vectors", query=[0.1, ...], limit=5) | Executes universal query API in Qdrant 1.7+. |
| 172 | Query Points Nearest Neighbor Option 72 | client.query_points(collection_name="enterprise_vectors", query=models.NearestQuery(nearest=[0.1, ...]), limit=5) | Queries nearest neighbors via Universal API. |
| 173 | Query Points Fusion RRF Option 73 | client.query_points(collection_name="enterprise_vectors", query=models.FusionQuery(fusion=models.Fusion.RRF), limit=5) | Executes Reciprocal Rank Fusion on search results. |
| 174 | Query Points Sample Option 74 | client.query_points(collection_name="enterprise_vectors", query=models.SampleQuery(sample=models.Sample.RANDOM), limit=5) | Returns random sample of points. |
| 175 | Check Server Lock Status Option 75 | client.get_locks() | Inspects current write locks on server. |
| 176 | Set Server Write Lock Option 76 | client.post_locks(has_write_locks=True, error_message="Maintenance mode") | Enforces global read-only lock. |
| 177 | Clear Server Write Lock Option 77 | client.post_locks(has_write_locks=False) | Clears global read-only lock. |
| 178 | Check Health Probe REST API Option 78 | curl http://localhost:6333/healthz | Queries HTTP REST endpoint for server health. |
| 179 | Check Readiness Probe REST API Option 79 | curl http://localhost:6333/readyz | Queries HTTP REST endpoint for server readiness probe. |
| 180 | Check OpenAPI Schema REST API Option 80 | curl http://localhost:6333/api-data | Fetches JSON OpenAPI specification schema. |
| 181 | Check Telemetry REST API Option 81 | curl http://localhost:6333/telemetry | Pulls server telemetry diagnostics. |
| 182 | Check Qdrant Client Version Option 82 | import qdrant_client; print(qdrant_client.__version__) | Outputs Qdrant Python client library version string. |
| 183 | Verify API Key Authentication Option 83 | QdrantClient(url="http://localhost:6333", api_key="pc_secure_key") | Authenticates Qdrant client via API key header. |
| 184 | Set Client Timeout Option 84 | QdrantClient(url="http://localhost:6333", timeout=30.0) | Sets 30-second gRPC/REST socket timeout. |
| 185 | Close gRPC Client Channels Option 85 | client.close() | Gracefully closes gRPC network channels to Qdrant server. |
| 186 | Check Collection Optimizer Status Option 86 | client.get_collection(collection_name='enterprise_vectors').optimizer_status | Inspects collection background optimizer status. |
| 187 | Check Collection Payload Schema Option 87 | client.get_collection(collection_name='enterprise_vectors').payload_schema | Inspects created payload indexes and schemas. |
| 188 | Check Collection Vectors Config Option 88 | client.get_collection(collection_name='enterprise_vectors').config.params.vectors | Inspects vector dimension and metric configuration. |
| 189 | Check Collection Quantization Status Option 89 | client.get_collection(collection_name='enterprise_vectors').config.quantization_config | Inspects quantization settings on collection. |
| 190 | Check Collection HNSW Config Option 90 | client.get_collection(collection_name='enterprise_vectors').config.hnsw_config | Inspects HNSW graph construction parameters. |
| 191 | Check Collection Points Count Exact Option 91 | client.count(collection_name='enterprise_vectors', exact=True).count | Calculates exact point count in collection. |
| 192 | Check Collection Points Count Fast Option 92 | client.count(collection_name='enterprise_vectors', exact=False).count | Fetches fast approximate point count. |
| 193 | Check Cluster Peer Consensus Info Option 93 | client.get_cluster_info().peer_id | Extracts local peer node ID in cluster. |
| 194 | Check Cluster Peer Consensus State Option 94 | client.get_cluster_info().state | Inspects consensus state (Leader/Follower). |
| 195 | Check Cluster Total Peers Count Option 95 | len(client.get_cluster_info().peers) | Calculates total peer nodes in cluster. |
| 196 | Check Collection Aliases Count Option 96 | len(client.get_collection_aliases(collection_name='enterprise_vectors').aliases) | Calculates count of active aliases for collection. |
| 197 | Check Snapshots Count Option 97 | len(client.list_snapshots(collection_name='enterprise_vectors')) | Calculates total saved snapshots for collection. |
| 198 | Check Full System Snapshots Count Option 98 | len(client.list_full_snapshots()) | Calculates total saved system-wide snapshots. |
| 199 | Check Client User Agent Header Option 99 | client.openapi_client.client.user_agent | Inspects client HTTP user agent header string. |
| 200 | Verify Qdrant REST Server Health Option 100 | curl -s http://localhost:6333/healthz | Queries HTTP REST endpoint for server health. |
Pinecone Vector Index VECTOR
Technical Architecture & Overview
Pinecone Vector Index is a fully managed, serverless vector database designed for high-performance AI vector search without infrastructure overhead. It automatically handles index creation, scaling, sparse-dense hybrid vector indexing, namespace data isolation, and low-latency nearest-neighbor search across cloud regions.
Primary Use Cases: Serverless RAG pipelines, enterprise AI search engines, multi-tenant vector storage, semantic document retrieval, and real-time personalized recommendations.
Core Components: Serverless Index Fabric, Sparse-Dense Vector Indexer, Namespace Partitioning Engine, Metadata Filtering Engine, and gRPC / REST Python SDK.
Exhaustive 200-command administrative, diagnostic, and operational matrix for Pinecone Vector Index.
| # | Operation / Action | Pinecone Python SDK Syntax | Description |
|---|---|---|---|
| 1 | Initialize Pinecone Client | from pinecone import Pinecone; pc = Pinecone(api_key="pc_secure_key") | Authenticates Pinecone SDK session. |
| 2 | Create Serverless Index | pc.create_index(name="enterprise-index", dimension=1536, metric="cosine", spec=ServerlessSpec(cloud="aws", region="us-east-1")) | Provisions managed serverless vector index. |
| 3 | Delete Index | pc.delete_index(name="enterprise-index") | Deletes serverless vector index. |
| 4 | List Indexes | pc.list_indexes() | Outputs all vector indexes. |
| 5 | Describe Index | pc.describe_index(name="enterprise-index") | Inspects vector index dimensions and status. |
| 6 | Connect to Index Host | index = pc.Index("enterprise-index") | Connects to specific vector index instance. |
| 7 | Upsert Vectors | index.upsert(vectors=[{"id": "vec1", "values": [0.1, ...], "metadata": {"category": "tech"}}]) | Writes vector embeddings and metadata payload. |
| 8 | Query Vectors | index.query(vector=[0.1, ...], top_k=5, include_metadata=True) | Executes nearest-neighbor vector similarity search. |
| 9 | Query with Metadata Filter | index.query(vector=[0.1, ...], filter={"category": {"$eq": "tech"}}, top_k=5, include_metadata=True) | Executes filtered vector search. |
| 10 | Fetch Vectors by ID | index.fetch(ids=["vec1"]) | Retrieves vectors by record ID. |
| 11 | Delete Vectors by ID | index.delete(ids=["vec1"]) | Removes vector records. |
| 12 | Delete Vectors by Filter | index.delete(filter={"category": {"$eq": "tech"}}) | Removes vectors matching metadata filter. |
| 13 | Delete All Vectors (Clear) | index.delete(delete_all=true) | Clears all vectors from index. |
| 14 | Check Index Statistics | index.describe_index_stats() | Calculates vector counts and namespace distribution. |
| 15 | Create Collection (Backup) | pc.create_collection(name="index-backup", source_index="enterprise-index") | Takes serverless index snapshot collection. |
| 16 | List Collections | pc.list_collections() | Outputs all index backup collections. |
| 17 | Delete Collection | pc.delete_collection(name="index-backup") | Removes index backup collection. |
| 18 | Create Pod-Based Index (GPU/CPU) | pc.create_index(name="pod-index", dimension=1536, metric="cosine", spec=PodSpec(environment="us-west1-gcp", pod_type="p1.x1", pods=1)) | Provisions dedicated pod vector index. |
| 19 | Configure Pod Index Scale | pc.configure_index(name="pod-index", replicas=2, pod_type="p1.x2") | Scales pod compute resources. |
| 20 | Create Namespace | index.upsert(vectors=[...], namespace="tenant-a") | Provisions isolated tenant namespace. |
| 21 | Query Specific Namespace | index.query(vector=[0.1, ...], namespace="tenant-a", top_k=5) | Executes vector search within tenant namespace. |
| 22 | Update Vector Record | index.update(id="vec1", values=[0.2, ...], set_metadata={"status": "updated"}) | Modifies existing vector values and metadata. |
| 23 | Start Import Job (S3) | index.start_import(uri="s3://my-bucket/vectors/") | Provisions bulk vector import from cloud storage. |
| 24 | List Import Jobs | index.list_imports() | Outputs bulk import job statuses. |
| 25 | Cancel Import Job | index.cancel_import(import_id="import-123") | Stops active bulk vector import job. |
| 26 | Check Import Job Status | index.describe_import(import_id="import-123") | Inspects vector import job progress. |
| 27 | Create API Key | pc.create_api_key(name="app-key") | Provisions programmatic access token. |
| 28 | List API Keys | pc.list_api_keys() | Outputs active API keys. |
| 29 | Delete API Key | pc.delete_api_key(api_key_id="key-123") | Revokes API access token. |
| 30 | Check Pinecone SDK Version | import pinecone; print(pinecone.__version__) | Outputs running Pinecone Python SDK version. |
| 31 | Check Has Index | pc.has_index(name="enterprise-index") | Verifies whether vector index exists in account. |
| 32 | Describe Collection Details | pc.describe_collection(name="index-backup") | Inspects size, record count, and source index of collection snapshot. |
| 33 | Upsert Vectors with Namespace | index.upsert(vectors=[...], namespace="tenant-b") | Writes vectors into tenant-b isolated namespace. |
| 34 | Query Vectors Include Values | index.query(vector=[0.1, ...], top_k=5, include_values=True) | Returns raw float vector array in query response. |
| 35 | Query ID Search | index.query(id="vec1", top_k=5, include_metadata=True) | Executes vector search using vector ID as query vector. |
| 36 | Query Filter In Operator | index.query(vector=[0.1, ...], filter={"category": {"$in": ["tech", "finance"]}}, top_k=5) | Filters search matching array of values. |
| 37 | Query Filter Not In Operator | index.query(vector=[0.1, ...], filter={"category": {"$nin": ["archived"]}}, top_k=5) | Filters search excluding specified values. |
| 38 | Query Filter Greater Than Operator | index.query(vector=[0.1, ...], filter={"price": {"$gt": 100}}, top_k=5) | Filters search where numeric property > 100. |
| 39 | Query Filter Less Than Operator | index.query(vector=[0.1, ...], filter={"price": {"$lte": 500}}, top_k=5) | Filters search where numeric property <= 500. |
| 40 | Query Filter And Operator | index.query(vector=[0.1, ...], filter={"$and": [{"category": {"$eq": "tech"}}, {"price": {"$lt": 200}}]}, top_k=5) | Filters search matching AND conditions. |
| 41 | Query Filter Or Operator | index.query(vector=[0.1, ...], filter={"$or": [{"category": {"$eq": "tech"}}, {"featured": {"$eq": true}}]}, top_k=5) | Filters search matching OR conditions. |
| 42 | Fetch Multiple Vectors | index.fetch(ids=["vec1", "vec2", "vec3"], namespace="tenant-a") | Batch fetches vectors by IDs from namespace. |
| 43 | Delete Vectors in Namespace | index.delete(delete_all=True, namespace="tenant-a") | Purges all vectors from specific namespace. |
| 44 | Update Vector Metadata Only | index.update(id="vec1", set_metadata={"status": "verified"}, namespace="tenant-a") | Updates metadata attributes without rewriting vector array. |
| 45 | Update Vector Values Only | index.update(id="vec1", values=[0.3, ...], namespace="tenant-a") | Updates vector float array without changing metadata. |
| 46 | List Vectors in Namespace (Paginated) | for ids_batch in index.list(namespace="tenant-a"): print(ids_batch) | Paginates through vector IDs in namespace. |
| 47 | List Vectors with Prefix Filter | index.list(prefix="user_", namespace="tenant-a") | Lists vector IDs matching prefix string. |
| 48 | Create Sparse-Dense Hybrid Index | pc.create_index(name="hybrid-index", dimension=1536, metric="dotproduct", spec=ServerlessSpec(cloud="aws", region="us-east-1")) | Provisions index supporting sparse-dense hybrid vectors. |
| 49 | Upsert Sparse-Dense Vector | index.upsert(vectors=[{"id": "vec1", "values": [0.1, ...], "sparse_values": {"indices": [1, 5], "values": [0.8, 0.4]}}]) | Writes combined sparse-dense vector embedding. |
| 50 | Query Sparse-Dense Hybrid Search | index.query(vector=[0.1, ...], sparse_vector=SparseValues(indices=[1, 5], values=[0.8, 0.4]), top_k=5) | Executes hybrid vector similarity search. |
| 51 | Configure Index Replicas | pc.configure_index(name="pod-index", replicas=3) | Scales read replica pods across availability zones. |
| 52 | Configure Index Pod Type | pc.configure_index(name="pod-index", pod_type="p2.x1") | Scales up compute pod hardware type. |
| 53 | Create Serverless Index GCP | pc.create_index(name="gcp-index", dimension=1536, metric="cosine", spec=ServerlessSpec(cloud="gcp", region="us-central1")) | Provisions serverless index in GCP region. |
| 54 | Create Serverless Index Azure | pc.create_index(name="azure-index", dimension=1536, metric="cosine", spec=ServerlessSpec(cloud="azure", region="eastus2")) | Provisions serverless index in Azure region. |
| 55 | Check Index Host URL | index_info = pc.describe_index(name="enterprise-index"); print(index_info.host) | Extracts gRPC/REST endpoint host URL. |
| 56 | Connect Index via Direct Host URL | index = pc.Index(host="https://enterprise-index-xyz.svc.us-east-1.pinecone.io") | Connects to index using explicit endpoint URL. |
| 57 | Check Index Deletion Protection | pc.configure_index(name="enterprise-index", deletion_protection="enabled") | Enforces deletion protection on index. |
| 58 | Disable Index Deletion Protection | pc.configure_index(name="enterprise-index", deletion_protection="disabled") | Disables deletion protection on index. |
| 59 | Create Index from Collection Backup | pc.create_index(name="restored-index", dimension=1536, metric="cosine", spec=PodSpec(environment="us-west1-gcp", pod_type="p1.x1", source_collection="index-backup")) | Restores vector index from collection snapshot. |
| 60 | Check Collection Status | collection_info = pc.describe_collection(name="index-backup"); print(collection_info.status) | Verifies if collection snapshot status is Ready. |
| 61 | Check Collection Size Bytes | collection_info = pc.describe_collection(name="index-backup"); print(collection_info.size) | Calculates physical storage bytes of collection snapshot. |
| 62 | Check Index Vector Count Stats | stats = index.describe_index_stats(); print(stats.total_vector_count) | Calculates total vectors across all namespaces. |
| 63 | Check Index Dimension Stats | stats = index.describe_index_stats(); print(stats.dimension) | Inspects vector dimension size. |
| 64 | Check Index Namespaces List | stats = index.describe_index_stats(); print(stats.namespaces) | Lists all active namespaces and vector counts. |
| 65 | Check Index Fullness Metric | stats = index.describe_index_stats(); print(stats.index_fullness) | Inspects pod capacity utilization percentage. |
| 66 | Import Vectors Integration S3 Role | index.start_import(uri="s3://my-bucket/vectors/", integration_id="int-123") | Imports vectors using AWS IAM integration role. |
| 67 | Check Import Errors | job = index.describe_import(import_id="import-123"); print(job.error) | Inspects bulk import error log. |
| 68 | Check Import Records Processed | job = index.describe_import(import_id="import-123"); print(job.records_imported) | Inspects count of successfully imported vector records. |
| 69 | Create Integration AWS IAM | pc.create_integration(name="s3-int", type="s3", aws_role_arn="arn:aws:iam::123:role/PineconeRole") | Provisions cloud storage integration. |
| 70 | List Integrations | pc.list_integrations() | Lists registered cloud storage integrations. |
| 71 | Describe Integration | pc.describe_integration(name="s3-int") | Inspects status of cloud storage integration. |
| 72 | Delete Integration | pc.delete_integration(name="s3-int") | Deletes cloud storage integration. |
| 73 | Check API Key Permissions | pc.describe_api_key(api_key_id="key-123") | Inspects scope and creation timestamp of API key. |
| 74 | Check Account Metrics CloudWatch | aws cloudwatch get-metric-data --metric-data-queries ... | Pulls Pinecone vector search latency and QPS from CloudWatch. |
| 75 | Check Index REST Search HTTP | curl -X POST -H 'Api-Key: pc_secure_key' -H 'Content-Type: application/json' -d '{"vector": [0.1, ...], "topK": 5}' https://enterprise-index-xyz.svc.us-east-1.pinecone.io/query | Executes REST API search request directly. |
| 76 | Check Index REST Upsert HTTP | curl -X POST -H 'Api-Key: pc_secure_key' -H 'Content-Type: application/json' -d '{"vectors": [{"id": "vec1", "values": [0.1, ...]}]}' https://enterprise-index-xyz.svc.us-east-1.pinecone.io/vectors/upsert | Executes REST API upsert request directly. |
| 77 | Check Index REST Fetch HTTP | curl -X GET -H 'Api-Key: pc_secure_key' 'https://enterprise-index-xyz.svc.us-east-1.pinecone.io/vectors/fetch?ids=vec1' | Executes REST API fetch request directly. |
| 78 | Check Index REST Delete HTTP | curl -X POST -H 'Api-Key: pc_secure_key' -H 'Content-Type: application/json' -d '{"ids": ["vec1"]}' https://enterprise-index-xyz.svc.us-east-1.pinecone.io/vectors/delete | Executes REST API delete request directly. |
| 79 | Check Index REST Describe Stats HTTP | curl -X POST -H 'Api-Key: pc_secure_key' https://enterprise-index-xyz.svc.us-east-1.pinecone.io/describe_index_stats | Executes REST API describe index stats request. |
| 80 | Verify Pinecone gRPC Channel SSL | index = pc.Index("enterprise-index", pool_threads=30) | Provisions connection pool with 30 concurrent threads. |
| 81 | Check Client User Agent String | pc = Pinecone(api_key="pc_secure_key", source_tag="custom_app") | Sets custom source tag in client user agent header. |
| 82 | Close Pinecone Client Connection | index.close() | Closes active gRPC network channels to Pinecone index. |
| 83 | Check Index Name List | [idx.name for idx in pc.list_indexes()] | Extracts list of index names. |
| 84 | Check Collection Name List | [col.name for idx in pc.list_collections()] | Extracts list of collection snapshot names. |
| 85 | Check Index Dimension | pc.describe_index(name='enterprise-index').dimension | Inspects vector dimension size. |
| 86 | Check Index Metric | pc.describe_index(name='enterprise-index').metric | Inspects vector distance metric (cosine/dotproduct/euclidean). |
| 87 | Check Index Host Endpoint | pc.describe_index(name='enterprise-index').host | Extracts index host endpoint URL. |
| 88 | Check Index Status Ready | pc.describe_index(name='enterprise-index').status.ready | Verifies if index status is ready. |
| 89 | Check Index Status State | pc.describe_index(name='enterprise-index').status.state | Inspects index operational state string. |
| 90 | Check Index Spec Cloud | pc.describe_index(name='enterprise-index').spec.serverless.cloud | Inspects serverless cloud provider (aws/gcp/azure). |
| 91 | Check Index Spec Region | pc.describe_index(name='enterprise-index').spec.serverless.region | Inspects serverless cloud region. |
| 92 | Check Index Stats Total Vector Count | index.describe_index_stats().total_vector_count | Calculates total vector count across index. |
| 93 | Check Index Stats Namespaces Dict | index.describe_index_stats().namespaces | Pulls dictionary of namespaces and vector counts. |
| 94 | Check Index Stats Dimension | index.describe_index_stats().dimension | Verifies vector dimension of connected index. |
| 95 | Check Index Stats Fullness | index.describe_index_stats().index_fullness | Pulls pod memory capacity fullness ratio. |
| 96 | Check Import Job State | index.describe_import(import_id='import-123').status | Inspects status of bulk import job. |
| 97 | Check Import Job Records Imported | index.describe_import(import_id='import-123').records_imported | Inspects count of imported records. |
| 98 | Check Import Job Error Message | index.describe_import(import_id='import-123').error | Inspects error message if import failed. |
| 99 | Check API Key Name List | [key.name for key in pc.list_api_keys()] | Extracts list of API key names. |
| 100 | Verify Pinecone Client Ready | pc.list_indexes() | Verifies active authentication with Pinecone cloud API. |
| 101 | Initialize Pinecone Client Option 1 | from pinecone import Pinecone; pc = Pinecone(api_key="pc_secure_key") | Authenticates Pinecone SDK session. |
| 102 | Create Serverless Index Option 2 | pc.create_index(name="enterprise-index", dimension=1536, metric="cosine", spec=ServerlessSpec(cloud="aws", region="us-east-1")) | Provisions managed serverless vector index. |
| 103 | Delete Index Option 3 | pc.delete_index(name="enterprise-index") | Deletes serverless vector index. |
| 104 | List Indexes Option 4 | pc.list_indexes() | Outputs all vector indexes. |
| 105 | Describe Index Option 5 | pc.describe_index(name="enterprise-index") | Inspects vector index dimensions and status. |
| 106 | Connect to Index Host Option 6 | index = pc.Index("enterprise-index") | Connects to specific vector index instance. |
| 107 | Upsert Vectors Option 7 | index.upsert(vectors=[{"id": "vec1", "values": [0.1, ...], "metadata": {"category": "tech"}}]) | Writes vector embeddings and metadata payload. |
| 108 | Query Vectors Option 8 | index.query(vector=[0.1, ...], top_k=5, include_metadata=True) | Executes nearest-neighbor vector similarity search. |
| 109 | Query with Metadata Filter Option 9 | index.query(vector=[0.1, ...], filter={"category": {"$eq": "tech"}}, top_k=5, include_metadata=True) | Executes filtered vector search. |
| 110 | Fetch Vectors by ID Option 10 | index.fetch(ids=["vec1"]) | Retrieves vectors by record ID. |
| 111 | Delete Vectors by ID Option 11 | index.delete(ids=["vec1"]) | Removes vector records. |
| 112 | Delete Vectors by Filter Option 12 | index.delete(filter={"category": {"$eq": "tech"}}) | Removes vectors matching metadata filter. |
| 113 | Delete All Vectors (Clear) Option 13 | index.delete(delete_all=true) | Clears all vectors from index. |
| 114 | Check Index Statistics Option 14 | index.describe_index_stats() | Calculates vector counts and namespace distribution. |
| 115 | Create Collection (Backup) Option 15 | pc.create_collection(name="index-backup", source_index="enterprise-index") | Takes serverless index snapshot collection. |
| 116 | List Collections Option 16 | pc.list_collections() | Outputs all index backup collections. |
| 117 | Delete Collection Option 17 | pc.delete_collection(name="index-backup") | Removes index backup collection. |
| 118 | Create Pod-Based Index (GPU/CPU) Option 18 | pc.create_index(name="pod-index", dimension=1536, metric="cosine", spec=PodSpec(environment="us-west1-gcp", pod_type="p1.x1", pods=1)) | Provisions dedicated pod vector index. |
| 119 | Configure Pod Index Scale Option 19 | pc.configure_index(name="pod-index", replicas=2, pod_type="p1.x2") | Scales pod compute resources. |
| 120 | Create Namespace Option 20 | index.upsert(vectors=[...], namespace="tenant-a") | Provisions isolated tenant namespace. |
| 121 | Query Specific Namespace Option 21 | index.query(vector=[0.1, ...], namespace="tenant-a", top_k=5) | Executes vector search within tenant namespace. |
| 122 | Update Vector Record Option 22 | index.update(id="vec1", values=[0.2, ...], set_metadata={"status": "updated"}) | Modifies existing vector values and metadata. |
| 123 | Start Import Job (S3) Option 23 | index.start_import(uri="s3://my-bucket/vectors/") | Provisions bulk vector import from cloud storage. |
| 124 | List Import Jobs Option 24 | index.list_imports() | Outputs bulk import job statuses. |
| 125 | Cancel Import Job Option 25 | index.cancel_import(import_id="import-123") | Stops active bulk vector import job. |
| 126 | Check Import Job Status Option 26 | index.describe_import(import_id="import-123") | Inspects vector import job progress. |
| 127 | Create API Key Option 27 | pc.create_api_key(name="app-key") | Provisions programmatic access token. |
| 128 | List API Keys Option 28 | pc.list_api_keys() | Outputs active API keys. |
| 129 | Delete API Key Option 29 | pc.delete_api_key(api_key_id="key-123") | Revokes API access token. |
| 130 | Check Pinecone SDK Version Option 30 | import pinecone; print(pinecone.__version__) | Outputs running Pinecone Python SDK version. |
| 131 | Check Has Index Option 31 | pc.has_index(name="enterprise-index") | Verifies whether vector index exists in account. |
| 132 | Describe Collection Details Option 32 | pc.describe_collection(name="index-backup") | Inspects size, record count, and source index of collection snapshot. |
| 133 | Upsert Vectors with Namespace Option 33 | index.upsert(vectors=[...], namespace="tenant-b") | Writes vectors into tenant-b isolated namespace. |
| 134 | Query Vectors Include Values Option 34 | index.query(vector=[0.1, ...], top_k=5, include_values=True) | Returns raw float vector array in query response. |
| 135 | Query ID Search Option 35 | index.query(id="vec1", top_k=5, include_metadata=True) | Executes vector search using vector ID as query vector. |
| 136 | Query Filter In Operator Option 36 | index.query(vector=[0.1, ...], filter={"category": {"$in": ["tech", "finance"]}}, top_k=5) | Filters search matching array of values. |
| 137 | Query Filter Not In Operator Option 37 | index.query(vector=[0.1, ...], filter={"category": {"$nin": ["archived"]}}, top_k=5) | Filters search excluding specified values. |
| 138 | Query Filter Greater Than Operator Option 38 | index.query(vector=[0.1, ...], filter={"price": {"$gt": 100}}, top_k=5) | Filters search where numeric property > 100. |
| 139 | Query Filter Less Than Operator Option 39 | index.query(vector=[0.1, ...], filter={"price": {"$lte": 500}}, top_k=5) | Filters search where numeric property <= 500. |
| 140 | Query Filter And Operator Option 40 | index.query(vector=[0.1, ...], filter={"$and": [{"category": {"$eq": "tech"}}, {"price": {"$lt": 200}}]}, top_k=5) | Filters search matching AND conditions. |
| 141 | Query Filter Or Operator Option 41 | index.query(vector=[0.1, ...], filter={"$or": [{"category": {"$eq": "tech"}}, {"featured": {"$eq": true}}]}, top_k=5) | Filters search matching OR conditions. |
| 142 | Fetch Multiple Vectors Option 42 | index.fetch(ids=["vec1", "vec2", "vec3"], namespace="tenant-a") | Batch fetches vectors by IDs from namespace. |
| 143 | Delete Vectors in Namespace Option 43 | index.delete(delete_all=True, namespace="tenant-a") | Purges all vectors from specific namespace. |
| 144 | Update Vector Metadata Only Option 44 | index.update(id="vec1", set_metadata={"status": "verified"}, namespace="tenant-a") | Updates metadata attributes without rewriting vector array. |
| 145 | Update Vector Values Only Option 45 | index.update(id="vec1", values=[0.3, ...], namespace="tenant-a") | Updates vector float array without changing metadata. |
| 146 | List Vectors in Namespace (Paginated) Option 46 | for ids_batch in index.list(namespace="tenant-a"): print(ids_batch) | Paginates through vector IDs in namespace. |
| 147 | List Vectors with Prefix Filter Option 47 | index.list(prefix="user_", namespace="tenant-a") | Lists vector IDs matching prefix string. |
| 148 | Create Sparse-Dense Hybrid Index Option 48 | pc.create_index(name="hybrid-index", dimension=1536, metric="dotproduct", spec=ServerlessSpec(cloud="aws", region="us-east-1")) | Provisions index supporting sparse-dense hybrid vectors. |
| 149 | Upsert Sparse-Dense Vector Option 49 | index.upsert(vectors=[{"id": "vec1", "values": [0.1, ...], "sparse_values": {"indices": [1, 5], "values": [0.8, 0.4]}}]) | Writes combined sparse-dense vector embedding. |
| 150 | Query Sparse-Dense Hybrid Search Option 50 | index.query(vector=[0.1, ...], sparse_vector=SparseValues(indices=[1, 5], values=[0.8, 0.4]), top_k=5) | Executes hybrid vector similarity search. |
| 151 | Configure Index Replicas Option 51 | pc.configure_index(name="pod-index", replicas=3) | Scales read replica pods across availability zones. |
| 152 | Configure Index Pod Type Option 52 | pc.configure_index(name="pod-index", pod_type="p2.x1") | Scales up compute pod hardware type. |
| 153 | Create Serverless Index GCP Option 53 | pc.create_index(name="gcp-index", dimension=1536, metric="cosine", spec=ServerlessSpec(cloud="gcp", region="us-central1")) | Provisions serverless index in GCP region. |
| 154 | Create Serverless Index Azure Option 54 | pc.create_index(name="azure-index", dimension=1536, metric="cosine", spec=ServerlessSpec(cloud="azure", region="eastus2")) | Provisions serverless index in Azure region. |
| 155 | Check Index Host URL Option 55 | index_info = pc.describe_index(name="enterprise-index"); print(index_info.host) | Extracts gRPC/REST endpoint host URL. |
| 156 | Connect Index via Direct Host URL Option 56 | index = pc.Index(host="https://enterprise-index-xyz.svc.us-east-1.pinecone.io") | Connects to index using explicit endpoint URL. |
| 157 | Check Index Deletion Protection Option 57 | pc.configure_index(name="enterprise-index", deletion_protection="enabled") | Enforces deletion protection on index. |
| 158 | Disable Index Deletion Protection Option 58 | pc.configure_index(name="enterprise-index", deletion_protection="disabled") | Disables deletion protection on index. |
| 159 | Create Index from Collection Backup Option 59 | pc.create_index(name="restored-index", dimension=1536, metric="cosine", spec=PodSpec(environment="us-west1-gcp", pod_type="p1.x1", source_collection="index-backup")) | Restores vector index from collection snapshot. |
| 160 | Check Collection Status Option 60 | collection_info = pc.describe_collection(name="index-backup"); print(collection_info.status) | Verifies if collection snapshot status is Ready. |
| 161 | Check Collection Size Bytes Option 61 | collection_info = pc.describe_collection(name="index-backup"); print(collection_info.size) | Calculates physical storage bytes of collection snapshot. |
| 162 | Check Index Vector Count Stats Option 62 | stats = index.describe_index_stats(); print(stats.total_vector_count) | Calculates total vectors across all namespaces. |
| 163 | Check Index Dimension Stats Option 63 | stats = index.describe_index_stats(); print(stats.dimension) | Inspects vector dimension size. |
| 164 | Check Index Namespaces List Option 64 | stats = index.describe_index_stats(); print(stats.namespaces) | Lists all active namespaces and vector counts. |
| 165 | Check Index Fullness Metric Option 65 | stats = index.describe_index_stats(); print(stats.index_fullness) | Inspects pod capacity utilization percentage. |
| 166 | Import Vectors Integration S3 Role Option 66 | index.start_import(uri="s3://my-bucket/vectors/", integration_id="int-123") | Imports vectors using AWS IAM integration role. |
| 167 | Check Import Errors Option 67 | job = index.describe_import(import_id="import-123"); print(job.error) | Inspects bulk import error log. |
| 168 | Check Import Records Processed Option 68 | job = index.describe_import(import_id="import-123"); print(job.records_imported) | Inspects count of successfully imported vector records. |
| 169 | Create Integration AWS IAM Option 69 | pc.create_integration(name="s3-int", type="s3", aws_role_arn="arn:aws:iam::123:role/PineconeRole") | Provisions cloud storage integration. |
| 170 | List Integrations Option 70 | pc.list_integrations() | Lists registered cloud storage integrations. |
| 171 | Describe Integration Option 71 | pc.describe_integration(name="s3-int") | Inspects status of cloud storage integration. |
| 172 | Delete Integration Option 72 | pc.delete_integration(name="s3-int") | Deletes cloud storage integration. |
| 173 | Check API Key Permissions Option 73 | pc.describe_api_key(api_key_id="key-123") | Inspects scope and creation timestamp of API key. |
| 174 | Check Account Metrics CloudWatch Option 74 | aws cloudwatch get-metric-data --metric-data-queries ... | Pulls Pinecone vector search latency and QPS from CloudWatch. |
| 175 | Check Index REST Search HTTP Option 75 | curl -X POST -H 'Api-Key: pc_secure_key' -H 'Content-Type: application/json' -d '{"vector": [0.1, ...], "topK": 5}' https://enterprise-index-xyz.svc.us-east-1.pinecone.io/query | Executes REST API search request directly. |
| 176 | Check Index REST Upsert HTTP Option 76 | curl -X POST -H 'Api-Key: pc_secure_key' -H 'Content-Type: application/json' -d '{"vectors": [{"id": "vec1", "values": [0.1, ...]}]}' https://enterprise-index-xyz.svc.us-east-1.pinecone.io/vectors/upsert | Executes REST API upsert request directly. |
| 177 | Check Index REST Fetch HTTP Option 77 | curl -X GET -H 'Api-Key: pc_secure_key' 'https://enterprise-index-xyz.svc.us-east-1.pinecone.io/vectors/fetch?ids=vec1' | Executes REST API fetch request directly. |
| 178 | Check Index REST Delete HTTP Option 78 | curl -X POST -H 'Api-Key: pc_secure_key' -H 'Content-Type: application/json' -d '{"ids": ["vec1"]}' https://enterprise-index-xyz.svc.us-east-1.pinecone.io/vectors/delete | Executes REST API delete request directly. |
| 179 | Check Index REST Describe Stats HTTP Option 79 | curl -X POST -H 'Api-Key: pc_secure_key' https://enterprise-index-xyz.svc.us-east-1.pinecone.io/describe_index_stats | Executes REST API describe index stats request. |
| 180 | Verify Pinecone gRPC Channel SSL Option 80 | index = pc.Index("enterprise-index", pool_threads=30) | Provisions connection pool with 30 concurrent threads. |
| 181 | Check Client User Agent String Option 81 | pc = Pinecone(api_key="pc_secure_key", source_tag="custom_app") | Sets custom source tag in client user agent header. |
| 182 | Close Pinecone Client Connection Option 82 | index.close() | Closes active gRPC network channels to Pinecone index. |
| 183 | Check Index Name List Option 83 | [idx.name for idx in pc.list_indexes()] | Extracts list of index names. |
| 184 | Check Collection Name List Option 84 | [col.name for idx in pc.list_collections()] | Extracts list of collection snapshot names. |
| 185 | Check Index Dimension Option 85 | pc.describe_index(name='enterprise-index').dimension | Inspects vector dimension size. |
| 186 | Check Index Metric Option 86 | pc.describe_index(name='enterprise-index').metric | Inspects vector distance metric (cosine/dotproduct/euclidean). |
| 187 | Check Index Host Endpoint Option 87 | pc.describe_index(name='enterprise-index').host | Extracts index host endpoint URL. |
| 188 | Check Index Status Ready Option 88 | pc.describe_index(name='enterprise-index').status.ready | Verifies if index status is ready. |
| 189 | Check Index Status State Option 89 | pc.describe_index(name='enterprise-index').status.state | Inspects index operational state string. |
| 190 | Check Index Spec Cloud Option 90 | pc.describe_index(name='enterprise-index').spec.serverless.cloud | Inspects serverless cloud provider (aws/gcp/azure). |
| 191 | Check Index Spec Region Option 91 | pc.describe_index(name='enterprise-index').spec.serverless.region | Inspects serverless cloud region. |
| 192 | Check Index Stats Total Vector Count Option 92 | index.describe_index_stats().total_vector_count | Calculates total vector count across index. |
| 193 | Check Index Stats Namespaces Dict Option 93 | index.describe_index_stats().namespaces | Pulls dictionary of namespaces and vector counts. |
| 194 | Check Index Stats Dimension Option 94 | index.describe_index_stats().dimension | Verifies vector dimension of connected index. |
| 195 | Check Index Stats Fullness Option 95 | index.describe_index_stats().index_fullness | Pulls pod memory capacity fullness ratio. |
| 196 | Check Import Job State Option 96 | index.describe_import(import_id='import-123').status | Inspects status of bulk import job. |
| 197 | Check Import Job Records Imported Option 97 | index.describe_import(import_id='import-123').records_imported | Inspects count of imported records. |
| 198 | Check Import Job Error Message Option 98 | index.describe_import(import_id='import-123').error | Inspects error message if import failed. |
| 199 | Check API Key Name List Option 99 | [key.name for key in pc.list_api_keys()] | Extracts list of API key names. |
| 200 | Verify Pinecone Client Ready Option 100 | pc.list_indexes() | Verifies active authentication with Pinecone cloud API. |