2006-Present eSMR Analytical Data (Parquet Format)
This resource contains a zipped set of files in the Apache Parquet file format (see: https://parquet.apache.org/), which include all of the eSMR analytical data from 2006 through present, partitioned by region (the California Water Board Region where the sampling site is located) and year (the calendar year in which the sample was taken). Parquet is a free and open source data storage format that allows for fast and efficient processing of large datasets. It is compatible with a variety of data analysis platforms, including the R and Python programming languages, through the Apache Arrow platform (see: https://arrow.apache.org/). See here for an example showing how to use this dataset with the R programming language.
The data in this dataset is essentially identical to that contained in the csv files for the individual years (with the exception that missing values in numeric and date fields are encoded as "NA" rather than "NaN" or empty text strings), and is included here as an alternative option for for users who want a bulk download of all of the eSMR data made available on the open data portal.
No inline preview is available for this format. Download the file (opens in a new tab) to view its contents.
Data dictionary
Field definitions supplied by the publishing agency in CKAN.
| Column | Type | Label | Description |
|---|---|---|---|
| filename | text | filename | — |
| compressed_size | numeric | compressed_size | — |
| file_size | numeric | file_size | — |
| compression_ratio | text | compression_ratio | — |
| date_time | timestamp | date_time | — |
| create_system | numeric | create_system | — |
| create_version | numeric | create_version | — |
| extract_version | numeric | extract_version | — |
| flag_bits | numeric | flag_bits | — |
| internal_attr | numeric | internal_attr | — |
| external_attr | numeric | external_attr | — |
| CRC | numeric | CRC | — |
| compress_type | numeric | compress_type | — |
Resource details
| Format | ZIP |
|---|---|
| Size | 271 MB |
| Rows | 222 |
| Last updated | Sep 30, 2026 |
| Part of | Water Quality - Effluent - Electronic Self-Monitoring Report (eSMR) Data |
Other resources in this dataset
- Data Dictionary - Electronic Self-Monitoring Report (eSMR) Data
- 2006-Present eSMR Analytical Data (Zipped CSV)
- 2026 eSMR Analytical Data
- 2025 eSMR Analytical Data
- 2024 eSMR Analytical Data
- 2023 eSMR Analytical Data
- 2022 eSMR Analytical Data
- 2021 eSMR Analytical Data
- 2020 eSMR Analytical Data
- 2019 eSMR Analytical Data
- 2018 eSMR Analytical Data
- 2017 eSMR Analytical Data
- 2016 eSMR Analytical Data
- 2015 eSMR Analytical Data
- 2014 eSMR Analytical Data
- 2013 eSMR Analytical Data
- 2012 eSMR Analytical Data
- 2011 eSMR Analytical Data
- 2010 eSMR Analytical Data
- 2009 eSMR Analytical Data
- 2008 eSMR Analytical Data
- 2007 eSMR Analytical Data
- 2006 eSMR Analytical Data
CKAN Data API
Access resource data through the CKAN DataStore API. The examples below use this resource's ID.
Endpoints
The Data API provides these actions. Creating or updating records requires appropriate permissions; the query actions read public DataStore records.
| Create | https://ckan.cdt.dev.datopian.com/api/3/action/datastore_create |
|---|---|
| Update / insert | https://ckan.cdt.dev.datopian.com/api/3/action/datastore_upsert |
| Query | https://ckan.cdt.dev.datopian.com/api/3/action/datastore_search |
| Query via SQL | https://ckan.cdt.dev.datopian.com/api/3/action/datastore_search_sql |
Query examples
"https://ckan.cdt.dev.datopian.com/api/3/action/datastore_search?resource_id=09b0cc76-f521-41bd-821a-b810d61d2e98&limit=5""https://ckan.cdt.dev.datopian.com/api/3/action/datastore_search?resource_id=09b0cc76-f521-41bd-821a-b810d61d2e98&q=jones""https://ckan.cdt.dev.datopian.com/api/3/action/datastore_search_sql?sql=SELECT%20%2A%20FROM%20%2209b0cc76-f521-41bd-821a-b810d61d2e98%22%20LIMIT%205"SQL queries depend on whether SQL search is enabled by the portal.
OData query
Use the resource's OData URL and its field names for paging, selecting columns, or filtering rows.
ODATA_RESOURCE_URL?$top=5
ODATA_RESOURCE_URL?$skip=5&$top=5
ODATA_RESOURCE_URL?$select=FIELD_NAME&$filter=FIELD_NAME eq 'VALUE'Replace ODATA_RESOURCE_URL, FIELD_NAME, and VALUE with the details for the selected resource. See the OData query options guide (opens in a new tab) for more examples.
Use the API in code
JavaScript (JSONP)
var data = { resource_id: '09b0cc76-f521-41bd-821a-b810d61d2e98', limit: 5, q: 'jones' };
$.ajax({
url: 'https://ckan.cdt.dev.datopian.com/api/3/action/datastore_search',
data: data,
dataType: 'jsonp',
success: function (response) {
console.log(response.result.total, response.result.records);
}
});Python
import json
from urllib.request import urlopen
url = 'https://ckan.cdt.dev.datopian.com/api/3/action/datastore_search?resource_id=09b0cc76-f521-41bd-821a-b810d61d2e98&limit=5'
with urlopen(url) as response:
result = json.load(response)['result']
print(result['total'], result['records'])For parameters and response fields, see the CKAN DataStore documentation (opens in a new tab).