_AlaSQL is an open source project used on more than two million page views per month - and we appreciate any and all contributions we can get. [Please help out](https://github.com/agershun/alasql/labels/Please%20help%20out%21)._
_Got a question? Ask on [Stack Overflow](http://stackoverflow.com/questions/ask?tags=AlaSQL) and tag with "alasql"._
[](https://travis-ci.org/agershun/alasql)
[](https://npm-stat.com/charts.html?package=alasql)
[](http://open-oss.com)
[](https://www.npmjs.com/package/alasql)
[](https://github.com/agershun/alasql)
[](http://isitmaintained.com/project/agershun/alasql "Average time to resolve an issue")
[](https://rawgit.com/agershun/alasql/develop/test/coverage/lcov-report/dist/alasql.fs.js.html)
[](https://bestpractices.coreinfrastructure.org/projects/328)
[](https://www.jsdelivr.com/package/npm/alasql)
[](https://github.com/prettier/prettier)
[](https://app.fossa.io/projects/git%2Bgithub.com%2Fagershun%2Falasql?ref=badge_small)
# AlaSQL
AlaSQL - _( [à la](http://en.wiktionary.org/wiki/%C3%A0_la) [SQL](http://en.wikipedia.org/wiki/SQL) ) [ælæ ɛskju:ɛl]_ - is an open source SQL database for Javascript with a strong focus on query speed and data source flexibility for both relational data and schemaless data. It works in your browser, Node.js, and Cordova.
This library is designed for:
* Fast in-memory SQL data processing for BI and ERP applications on fat clients
* Easy ETL and options for persistencey by data import / manipulation / export of several formats
* All major browsers, Node.js, and mobile applications
We focus on [speed](https://github.com/agershun/alasql/wiki/Speed) by taking advantage of the dynamic nature of JavaScript when building up queries. Real-world solutions demand flexibility regarding where data comes from and where it is to be stored. We focus on flexibility by making sure you can [import/export](https://github.com/agershun/alasql/wiki/Import-export) and query directly on data stored in Excel (both `.xls` and `.xlsx`), CSV, JSON, TAB, IndexedDB, LocalStorage, and SQLite files.
The library adds the comfort of a full database engine to your JavaScript app. No, really - it's working towards a full database engine complying with [most of the SQL-99](https://github.com/agershun/alasql/wiki/Supported-SQL-statements) spiced up with an additional syntax for handling NoSQL (schema-less) data and graph networks.
```js
// A) Traditional SQL
alasql("CREATE TABLE cities (city string, population number)");
alasql("INSERT INTO cities VALUES ('Rome',2863223),('Paris',2249975),('Berlin',3517424),('Madrid',3041579)");
var res = alasql("SELECT * FROM cities WHERE population < 3500000 ORDER BY population DESC");
console.log(res);
/*
[
{
"city": "Madrid",
"population": 3041579
},
{
"city": "Rome",
"population": 2863223
},
{
"city": "Paris",
"population": 2249975
}
]
*/
```
```js
// B) Select from array of objects
var data = [{a:1,b:10}, {a:2,b:20}, {a:1,b:30}];
var res = alasql('SELECT a, SUM(b) AS b FROM ? GROUP BY a',[data]);
console.log(res); // [{"a":1,"b":40},{"a":2,"b":20}]
```
```js
// C) Read from file must be async (Promise returned when SQL given as array)
alasql(['SELECT * FROM XLS("./data/mydata") WHERE lastname LIKE "A%" and city = "London" GROUP BY name '])
.then(function(res){
console.log(res); // output depends on mydata.xls
}).catch(function(err){
console.log('Does the file exist? There was an error:', err);
});
```
```js
// D) Cheat and load your data directly
alasql("CREATE TABLE example1 (a INT, b INT)");
alasql.tables.example1.data = [ // Insert data directly from JavaScript object...
{a:2,b:6},
{a:3,b:4}
];
alasql("INSERT INTO example1 VALUES (1,5)"); // ...or insert data with normal SQL
var res = alasql("SELECT * FROM example1 ORDER BY b DESC");
console.log(res); // [{a:2,b:6},{a:1,b:5},{a:3,b:4}]
```
jsFiddle with [example A)](http://jsfiddle.net/2aorhk1d/) and [example B)](http://jsfiddle.net/ztfhdrsv/)
__If you are familiar with SQL it should come as no surprise that proper use of indexes on your tables is essential to get good performance.__
## Install
```bash
npm install --save alasql # node
bower install --save alasql # bower
import alasql from 'alasql'; # meteor
npm install -g alasql # command line
```
For the browser: include [alasql.min.js](https://cdn.jsdelivr.net/npm/alasql)
```html
```
## Get started
The wiki has a great section on [how to get started](https://github.com/agershun/alasql/wiki/Getting%20started)
When you feel you've gotten a grip, you can check out the wiki section about [data manipulation](https://github.com/agershun/alasql/wiki/Data-manipulation) or get inspired by the [list of Q&As](http://stackoverflow.com/questions/tagged/alasql)
* Documentation: [Github wiki](https://github.com/agershun/alasql/wiki)
* Library CDN: [jsDelivr.com](http://www.jsdelivr.com/#!alasql)
* Feedback: [Open an issue](https://github.com/agershun/alasql/issues/new)
* Try online: Playground
* Website: [alasql.org](http://AlaSQL.org)
## Please note
**All contributions are extremely welcome and greatly appreciated(!)** -
The project has never received any funding and is based on unpaid voluntary work: [We really (really) love pull requests](https://github.com/agershun/alasql/blob/develop/CONTRIBUTING.md)
AlaSQL project is very young and still in an active development phase, therefore it may have [bugs](https://github.com/agershun/alasql/labels/%21%20Bug).
Please, submit any bugs and suggestions [as an issue](https://github.com/agershun/alasql/issues/new).
[](https://github.com/agershun/alasql/issues?q=is%3Aissue+is%3Aopen+label%3A%22%21+Bug%22)
AlaSQL uses [Semantic Versioning](http://semver.org/) so please note that the major version is zero (0.y.z) and the API can not be considered 100% stable. Consider this before using the library in production and please check out the [limitations of the library](https://github.com/agershun/alasql#limitations)
## Performance
AlaSQL is very focused on speed, and we make sure to use all the tricks we can find to make JavaScript spit out your results as quickly as possible. For example:
* Queries are cached as compiled functions
* Joined tables are pre-indexed
* ```WHERE``` expressions are pre-filtered for joins
The results are good. Check out AlaSQL vs. other JavaScript SQL databases:
* **3x speed** [compared to SQL.js](http://jsperf.com/sql-js-vs-alasql-js/11) selecting with `SUM`, `JOIN`, and `GROUP BY`.
* **1x speed** [compared to WebSQL](http://jsperf.com/alasql-js-vs-websql/8) selecting with `SUM`, `JOIN`, and `GROUP BY` (in-memory operations for WebSQL - see [this discussion](https://github.com/agershun/alasql/issues/47))
* **2x speed** [compared to Linq](http://jsperf.com/alasql-vs-linq-on-groupby/3) for `GROUP BY` on 1,048,576 rows
Please remember to set indexes on your tables to speed up your queries. [Have a look here](https://www.tutorialspoint.com/sql/sql-indexes.htm) and [SQL Index](http://www.guru99.com/indexes.html) page if you are unfamiliar with this concept (this is a part of [SQL Tutorial](http://www.guru99.com/sql.html)).
See more [speed related info on the wiki](https://github.com/agershun/alasql/wiki/Speed)
## Features you might like
### Traditional SQL
Use "good old" SQL on your data with multiple levels of: `JOIN`, `VIEW`, `GROUP BY`, ```UNION```, ```PRIMARY KEY```, `ANY`, `ALL`, ```IN```, ```ROLLUP()```, ```CUBE()```, ```GROUPING SETS()```, ```CROSS APPLY```, ```OUTER APPLY```, ```WITH SELECT```, and subqueries. See the wiki to [compare supported features with SQL standards](https://github.com/agershun/alasql/wiki/SQL%20keywords).
### User defined functions in your SQL
You can use all benefits of SQL and JavaScript together by defining your own custom functions. Just add new functions to the alasql.fn object:
```js
alasql.fn.myfn = function(a,b) {
return a*b+1;
}
var res = alasql('SELECT myfn(a,b) FROM one');
```
You can also define your own aggregator functions (like your own `SUM(...)`). See more [in the wiki](https://github.com/agershun/alasql/wiki/User-Defined-Functions)
### Compiled statements and functions
```js
var ins = alasql.compile('INSERT INTO one VALUES (?,?)');
ins(1,10);
ins(2,20);
```
See more [in the wiki](https://github.com/agershun/alasql/wiki/Compile)
### SELECT directly on your JavaScript data
Group your JavaScript array of objects by field and count number of records in each group:
```js
var data = [{a:1,b:1,c:1},{a:1,b:2,c:1},{a:1,b:3,c:1}, {a:2,b:1,c:1}];
var res = alasql('SELECT a, COUNT(*) AS b FROM ? GROUP BY a',[data]);
console.log(res);
```
See more ideas for creative data manipulation [in the wiki](https://github.com/agershun/alasql/wiki/Getting-started)
### JavaScript Sugar
AlaSQL extends "good old" SQL to make it closer to JavaScript. The "sugar" includes:
* Write Json objects - `{a:'1',b:@['1','2','3']}`
* Acesss object propertires - `obj->property->subproperty`
* Access Ooject and arrays elements - ```obj->(a*1)```
* Access JavaScript functions - ```obj->valueOf()```
* Format query output with `SELECT VALUE, ROW, COLUMN, MATRIX`
* ES5 multiline SQL with `var SQL = function(){/*select 'MY MULTILINE SQL'*/}` and pass instead of SQL string (will not work if you compress your code)
### Read and write Excel, and raw data files
You can import from and export to CSV, TAB, TXT, and JSON files. File extensions can be omitted. Calls to files will always be [[async]] so the approach is to chain the queries if you have more than one:
```js
var tabFile = 'mydata.tab'
alasql.promise([
"select * from txt('MyFile.log') where [0] like 'M%'",
["select * from tab(?) order by [1]", [tabFile]], // note how to pass parameter when promises are chained
"select [3] as city,[4] as population from csv('./data/cities')",
"select * from json('../config/myJsonfile')"
]).then(function(results){
console.log(results)
}).catch(console.error)
```
### Read SQLite database files
AlaSQL can read (but not write) SQLite data files if you include the [SQL.js](https://github.com/kripken/sql.js) library:
```html
```
sql.js calls will always be async.
### AlaSQL works in the console - CLI
After globally installing AlaSQL `npm install alasql -g` you can access AlaSQL via the commandline
```bash
> alasql "SET @data = @[{a:'1',b:?},{a:'2',b:?}]; SELECT a, b FROM @data;" 10 20
[ 1, [ { a: 1, b: 10 }, { a: 2, b: 20 } ] ]
> alasql "VALUE OF SELECT COUNT(*) as abc FROM TXT('README.md') WHERE LENGTH([0]) > ?" 140
// Number of lines with more than 140 characters in README.md
```
See more [in the wiki](https://github.com/agershun/alasql/wiki/AlaSQL-CLI)
## Features you might love
### AlaSQL ♥ D3.js
AlaSQL plays nice with d3.js and gives you a convenient way to integrate a specific subset of your data with the visual powers of D3. See more about [D3.js and AlaSQL in the wiki](https://github.com/agershun/alasql/wiki/d3.js)
### AlaSQL ♥ Excel
AlaSQL can export data to both [Excel 2003 (.xls)](https://github.com/agershun/alasql/wiki/XLS) and [Excel 2007 (.xlsx)](https://github.com/agershun/alasql/wiki/XLSX) formats with coloring of cells and other Excel formatting functions.
### AlaSQL ♥ Meteor
Meteor is amazing. You can query directly on your Meteor collections with SQL - simple and easy. See more about [Meteor and AlaSQL in the wiki](https://github.com/agershun/alasql/wiki/Meteor)
### AlaSQL ♥ Angular.js
Angular is great. In addition to normal data manipulation, AlaSQL works like a charm for exporting your present scope to Excel. See more about [Angular and AlaSQL in the wiki](https://github.com/agershun/alasql/wiki/Angular.js)
### AlaSQL ♥ Google Maps
Pinpointing data on a map should be easy. AlaSQL is great to prepare source data for Google Maps from, for example, Excel or CSV, making it one unit of work for fetching and identifying what's relevant. See more about [Google Maps and AlaSQL in the wiki](https://github.com/agershun/alasql/wiki/Google-maps)
### AlaSQL ♥ Google Spreadsheets
AlaSQL can query data directly from a Google spreadsheet. A good "partnership" for easy editing and powerfull data manipulation. See more about [Google Spreadsheets and AlaSQL in the wiki](https://github.com/agershun/alasql/wiki/Google-Spreadsheets)
### Miss a feature?
Take charge and [add your idea](http://feathub.com/agershun/alasql/features/new) or [vote for your favorite feature](http://feathub.com/agershun/alasql) to be implemented:
[](http://feathub.com/agershun/alasql)
## Limitations
Please be aware that AlaSQL has [bugs](https://github.com/agershun/alasql/labels/Bug). Beside having some bugs, there are a number of limitations:
0. AlaSQL has a (long) list of keywords that must be escaped if used for column names. When selecting a field named `key` please write ``` SELECT `key` FROM ... ``` instead. This is also the case for words like ``` `value` ```, ``` `read` ```, ``` `count` ```, ``` `by` ```, ``` `top` ```, ``` `path` ```, ``` `deleted` ```, ``` `work` ``` and ``` `offset` ```. Please consult the [full list of keywords](https://github.com/agershun/alasql/wiki/AlaSQL-Keywords).
0. It is OK to `SELECT` 1000000 records or to `JOIN` two tables with 10000 records in each (You can use streaming functions to work with longer datasources - see [test/test143.js](test/test143.js)) but be aware that the workload is multiplied so `SELECT`ing from more than 8 tables with just 100 rows in each will show bad performance. This is one of our top priorities to make better.
0. Limited functionality for transactions (supports only for localStorage) - Sorry, transactions are limited, because AlaSQL switched to more complex approach for handling `PRIMARY KEY`s / `FOREIGN KEY`s. Transactions will be fully turned on again in a future version.
0. A `(FULL) OUTER JOIN` and `RIGHT JOIN` of more than 2 tables will not produce expected results. `INNER JOIN` and `LEFT JOIN` are OK.
0. Please use aliases when you want fields with the same name from different tables (`SELECT a.id as a_id, b.id as b_id FROM ?`).
0. At the moment AlaSQL does not work with JSZip 3.0.0 - please use version 2.x.
0. `JOIN`ing a sub-`SELECT` does not work. Please use a `with` structure ([Example here](https://github.com/agershun/alasql/issues/832#issuecomment-377574550)) or fetch the sub-`SELECT` to a variable and pass it as an argument ([Example here](https://github.com/agershun/alasql/issues/832#issuecomment-377559478)).
0. AlaSQL uses the [FileSaver.js](https://github.com/eligrey/FileSaver.js/) library for saving files locally from the browser. Please be aware that it does not save files in Safari 8.0.
There are probably many others. Please help us fix them by [submitting an issue](https://github.com/agershun/alasql/issues). Thank you!
## How To
### Use AlaSQL to convert data from CSV to Excel
ETL example:
```js
alasql(['CREATE TABLE IF NOT EXISTS geo.country',
'SELECT * INTO geo.country FROM CSV("country.csv",{headers:true})',
'SELECT * INTO XLSX("asia") FROM geo.country WHERE continent_name = "Asia"'
).then(function(res){
... // results from the file asia.xlsx
});
```
### Use AlaSQL as a Web Worker
AlaSQL can serve as a Web Worker. Please be aware that all interaction with AlaSQL when running must be async.
In the browser you can include `alasql-worker.min.js` instead of `alasql.min.js` and AlaSQL will figure out the rest:
```html
```
Try the [jsFiddle example](http://jsfiddle.net/agershun/oxv4rzzc/).
Another option is to include `alasql.min.js` as usual but call `alasql.worker()` as the first thing yourself:
```html
```
Try this [jsFiddle example](http://jsfiddle.net/agershun/rjwp8u48/3/).
If using AlaSQL as Web Worker, you can import it traditionally as a script:
```js
importScripts('alasql.min.js');
```
### Webpack, Browserify, Vue and React (Native)
To use AlaSQL within a `create-react-app` (CRA) setup **without** ejecting it is: Please [have a look at this comment](https://github.com/agershun/alasql/issues/930#issuecomment-322413745).
When targeting the browser, several code bundlers like Webpack and Browserify will pick up modules you might not want.
Here's a list of modules that AlaSQL may require in certain enviroments or for certain features:
* Node.js
* fs
* net
* tls
* request
* path
* React Native
* react-native
* react-native-fs
* react-native-fetch-blob
* Vertx
* vertx
* Agonostic
* XLSX/XLS support
* cptable
* jszip
* xlsx
* cpexcel
* es6-promise
#### Webpack
There are several ways to handle AlaSQL with Webpack:
##### IgnorePlugin
Ideal when you want to control which modules you want to import.
```js
var IgnorePlugin = require("webpack").IgnorePlugin;
module.exports = {
...
//Will ignore the modules fs, path, xlsx, request, vertx, and react-native modules
plugins:[new IgnorePlugin(/(^fs$|cptable|jszip|xlsx|^es6-promise$|^net$|^tls$|^forever-agent$|^tough-cookie$|cpexcel|^path$|^request$|react-native|^vertx$)/)]
};
```
##### module.noParse
As of AlaSQL 0.3.5, you can simply tell Webpack not to parse AlaSQL, which avoids all the dynamic `require` warnings and avoids using `eval`/clashing with CSP with script-loader.
[Read the Webpack docs about noParse](https://webpack.github.io/docs/configuration.html#module-noparse)
```js
...
//Don't parse alasql
{module:noParse:[/alasql/]}
```
##### script-loader
If both of the solutions above fail to meet your requirements, you can load AlaSQL with [script-loader](https://github.com/webpack/script-loader).
```js
//Load alasql in the global scope with script-loader
import "script!alasql"
```
This can cause issues if you have a CSP that doesn't allow `eval`.
#### Browserify
Read up on [excluding](https://github.com/substack/browserify-handbook#excluding), [ignoring](https://github.com/substack/browserify-handbook#ignoring), and [shimming](https://github.com/substack/browserify-handbook#shimming)
Example (using excluding)
```js
var browserify = require("browserify");
var b = browserify("./main.js").bundle();
//Will ignore the modules fs, path, xlsx
["fs","path","xlsx", ... ].map(ignore => b.ignore(ignore));
```
#### Vue
For some frameworks (lige Vue) alasql cant access XLSX by it self. We recommend handeling it by including AlaSQL the following way:
```import alasql from 'alasql';
import XLSX from 'xlsx';
alasql.utils.isBrowserify = false;
alasql.utils.global.XLSX = XLSX;
```
#### jQuery
Please remember to send the original event, and not the jQuery event, for elements. (Use `event.originalEvent` instead of `myEvent`)
### JSON-object
You can use JSON objects in your databases (do not forget use == and !== operators for deep comparision of objects):
```sql
alasql> SELECT VALUE {a:'1',b:'2'}
{a:1,b:2}
alasql> SELECT VALUE {a:'1',b:'2'} == {a:'1',b:'2'}
true
alasql> SELECT VALUE {a:'1',b:'2'}->b
2
alasql> SELECT VALUE {a:'1',b:(2*2)}->b
4
```
Try AlaSQL JSON objects in Console [sample](http://alasql.org/console?drop table if exists one;create table one;insert into one values {a:@[1,2,3],c:{e:23}}, {a:@[{b:@[1,2,3]}]};select * from one)
## Experimental
_Useful stuff, but there might be dragons_
### Graphs
AlaSQL is a multi-paradigm database with support for graphs that can be searched or manipulated.
```js
// Who loves lovers of Alice?
var res = alasql('SEARCH / ANY(>> >> #Alice) name');
console.log(res) // ['Olga','Helen']
```
See more [at the wiki](https://github.com/agershun/alasql/wiki/GRAPH)
### localStorage and DOM-storage
You can use browser localStorage and [DOM-storage](https://github.com/node-browser-compat/dom-storage) as a data storage. Here is a sample:
```js
alasql('CREATE localStorage DATABASE IF NOT EXISTS Atlas');
alasql('ATTACH localStorage DATABASE Atlas AS MyAtlas');
alasql('CREATE TABLE IF NOT EXISTS MyAtlas.City (city string, population number)');
alasql('SELECT * INTO MyAtlas.City FROM ?',[[{city:'Vienna', population:1731000},
{city:'Budapest', population:1728000}]]);
var res = alasql('SELECT * FROM MyAtlas.City');
console.log(res);
```
Try this sample in [jsFiddle](http://jsfiddle.net/agershun/x1gq3wf2/). Run this sample
two or three times, and AlaSQL store more and more data in localStorage. Here, "Atlas" is
the name of localStorage database, where "MyAtlas" is a memory AlaSQL database.
You can use localStorage in two modes: `SET AUTOCOMMIT ON` to immediate save data
to localStorage after each statement or `SET AUTOCOMMIT OFF`. In this case, you need
to use `COMMIT` statement to save all data from in-memory mirror to localStorage.
### AlaSQL supports plugins
AlaSQL supports plugins. To install a plugin you need to use the `REQUIRE` statement. See more [at the wiki](https://github.com/agershun/alasql/wiki/Plugins)
### Alaserver - simple database server
Yes, you can even use AlaSQL as a very simple server for tests.
To run enter the command:
```
alaserver [port]
```
then type in browser something like "http://127.0.0.1:1337/?SELECT VALUE 2*2"
Warning: Alaserver is not multi-threaded, not concurrent, and not secured.
## Tests
### Regression tests
AlaSQL currently has over 1200 regression tests, but they only cover [](https://rawgit.com/agershun/alasql/develop/test/coverage/lcov-report/dist/alasql.fs.js.html)
of the codebase.
AlaSQL uses `mocha` for regression tests. Install `mocha` and run
```
> npm test
```
or run [test/index.html](test/index.html) for in-browser tests (Please serve via localhost with, for example, `http-server`).
#### Tests with AlaSQL ASSERT from SQL
You can use AlaSQL's [ASSERT](wiki/Assert) operator to test the results of previous operation:
```sql
CREATE TABLE one (a INT);
ASSERT 1;
INSERT INTO one VALUES (1),(2),(3);
ASSERT 3;
SELECT * FROM one ORDER BY a DESC;
ASSERT [{a:3},{a:2},{a:1}];
```
#### SQLLOGICTEST
AlaSQL uses SQLLOGICTEST to test its compatibility with SQL-99. The tests include about 2 million queries and statements.
The testruns can be found in the [testlog](TESTLOG.md).
## Bleeding edge
If you want to try the most recent development version of the library please download [this file](https://github.com/agershun/alasql/blob/develop/dist/alasql.fs.js) or visit the [testbench](https://rawgit.com/agershun/alasql/develop/utils/testbench.html) to play around in the browser console.
## License
MIT - see [MIT licence information](LICENSE)
## Main contributors
* [Andrey Gershun](http://github.com/agershun)
* [Mathias Rangel Wulff](https://twitter.com/rangelwulff)
AlaSQL is an **OPEN Open Source Project**. This means that:
> Individuals making significant and valuable contributions are given commit-access to the project to contribute as they see fit. This project is more like an open wiki than a standard guarded open source project.
We appreciate any and all contributions we can get. If you feel like contributing, have a look at [CONTRIBUTING.md](https://github.com/agershun/alasql/blob/develop/CONTRIBUTING.md)._
## Credits
Many thanks to Zach Carter for [Jison](http://zaach.github.io/jison/) parser generator, to the author of FileSaver.js, Andrew Kent for his [SQL Parser](https://github.com/forward/sql-parser),
authors of [XLSX](https://github.com/SheetJS/js-xlsx) library,
and other people for useful tools, which make our work much easier.
### Related projects that have inspired us
* [AlaX](http://github.com/agershun/alax) - Export to Excel with colors and formats
* [WebSQLShim](http://github.com/agershun/WebSQLShim) - WebSQL shim over IndexedDB (work in progress)
* [AlaMDX](http://github.com/agershun/alamdx) - JavaScript MDX OLAP library (work in progress)
* [Other similar projects](http://github.com/agershun/alasql/wiki/Similar-Projects.md) - list of databases on JavaScript
----
© 2014-2018, Andrey Gershun (agershun@gmail.com) & Mathias Rangel Wulff (m@rawu.dk)