605 Commits

Author SHA1 Message Date
stevedodson
5995e11bfd
Update README.md 2020-01-13 10:22:42 +00:00
stevedodson
a4736150f6
Update README.md 2020-01-13 09:01:34 +00:00
stevedodson
d7207bab3b
7.5.1a2 (#110)
* Updating README.md

* New version

* Fixing description for pypi
7.5.1a2
2020-01-10 15:40:15 +00:00
stevedodson
00fb775d29
Feature/versioning (#109)
* Minor fixes for readthedocs compatibility.

* Adding doc templates

* Setting first version to 7.5

* Resolving pypi issues + minor docs
7.5.1a1
2020-01-10 14:38:56 +00:00
stevedodson
f93b893f9d
Setting version number to valid version (#108)
* Minor fixes for readthedocs compatibility.

* Adding doc templates

* Setting first version to 7.5
2020-01-10 11:47:52 +00:00
stevedodson
1c772d0e50
More readthedocs fixes. (#107)
* Minor fixes for readthedocs compatibility.

* Adding doc templates
2020-01-10 11:33:51 +00:00
stevedodson
1d273ae465
Update README.md 2020-01-10 11:13:29 +00:00
stevedodson
679f8f4170
Minor fixes for readthedocs compatibility. (#106) 2020-01-10 11:02:51 +00:00
stevedodson
c3c2f8a020
Minor updates to README.md + merge fixes (#105) 2020-01-10 09:26:13 +00:00
stevedodson
a3293168a1
Feature/filtered hist (#104)
* Adding python 3.5 compatibility.

Main issue is ordering of dictionaries.

* Updating notebooks with 3.7 results.

* Removing tempoorary code.

* Defaulting to OrderedDict for python 3.5 + lint all code

All code reformated by PyCharm and inspection results analysed.

* Adding support for multiple arithmetic operations.

Added new 'arithmetics' file to manage this process.
More tests to be added + cleanup.

* Signficant refactor to arithmetics and mappings.

Work in progress. Tests don't pass.

* Major refactor to Mappings.

Field name mappings were stored in different places
(Mappings, QueryCompiler, Operations) and needed to
be keep in sync.

With the addition of complex arithmetic operations
this became complex and difficult to maintain. Therefore,
all field naming is now in 'FieldMappings' which
replaces 'Mappings'.

Note this commit removes the cache for some of the
mapped values and so the code is SIGNIFICANTLY
slower on large indices.

In addition, the addition of date_format to
Mappings has been removed. This again added more
unncessary complexity.

* Adding OrderedDict for 3.5 compatibility

* Fixes to ordering issues with 3.5

* Adding simple cache for mappings in flatten

Improves performance significantly on large
datasets (>10000 rows).

* Adding updated notebooks (new info_es).

All tests (doc + nbval + pytest) pass.

* Fixing issue with non-zero offset histograms.
2020-01-10 08:17:45 +00:00
stevedodson
903fbf0341
Feature/mapping cache (#103)
* Adding python 3.5 compatibility.

Main issue is ordering of dictionaries.

* Updating notebooks with 3.7 results.

* Removing tempoorary code.

* Defaulting to OrderedDict for python 3.5 + lint all code

All code reformated by PyCharm and inspection results analysed.

* Adding support for multiple arithmetic operations.

Added new 'arithmetics' file to manage this process.
More tests to be added + cleanup.

* Signficant refactor to arithmetics and mappings.

Work in progress. Tests don't pass.

* Major refactor to Mappings.

Field name mappings were stored in different places
(Mappings, QueryCompiler, Operations) and needed to
be keep in sync.

With the addition of complex arithmetic operations
this became complex and difficult to maintain. Therefore,
all field naming is now in 'FieldMappings' which
replaces 'Mappings'.

Note this commit removes the cache for some of the
mapped values and so the code is SIGNIFICANTLY
slower on large indices.

In addition, the addition of date_format to
Mappings has been removed. This again added more
unncessary complexity.

* Adding OrderedDict for 3.5 compatibility

* Fixes to ordering issues with 3.5

* Adding simple cache for mappings in flatten

Improves performance significantly on large
datasets (>10000 rows).

* Adding updated notebooks (new info_es).

All tests (doc + nbval + pytest) pass.
2020-01-10 08:12:03 +00:00
stevedodson
efe21a6d87
Feature/arithmetic ops (#102)
* Adding python 3.5 compatibility.

Main issue is ordering of dictionaries.

* Updating notebooks with 3.7 results.

* Removing tempoorary code.

* Defaulting to OrderedDict for python 3.5 + lint all code

All code reformated by PyCharm and inspection results analysed.

* Adding support for multiple arithmetic operations.

Added new 'arithmetics' file to manage this process.
More tests to be added + cleanup.

* Signficant refactor to arithmetics and mappings.

Work in progress. Tests don't pass.

* Major refactor to Mappings.

Field name mappings were stored in different places
(Mappings, QueryCompiler, Operations) and needed to
be keep in sync.

With the addition of complex arithmetic operations
this became complex and difficult to maintain. Therefore,
all field naming is now in 'FieldMappings' which
replaces 'Mappings'.

Note this commit removes the cache for some of the
mapped values and so the code is SIGNIFICANTLY
slower on large indices.

In addition, the addition of date_format to
Mappings has been removed. This again added more
unncessary complexity.

* Adding OrderedDict for 3.5 compatibility

* Fixes to ordering issues with 3.5
2020-01-10 08:05:43 +00:00
Martijn Laarman
617583183f Move to latest .ci script structure (#101)
Introduces a dedicated `run-repository.sh` for the repository custom
bits.

This allows us to keep `run-elasticsearch.sh` and `run-tests` in sync
through file copying or patches easier.
2020-01-09 11:18:56 +01:00
stevedodson
bdaea4658c
Fixing addition repr test for python 3.5. (#100) 2019-12-12 15:57:52 +01:00
Camilla
a5380813a7
Adds Python 3.8 support (#96)
* Adds build status sticker to README

* Adds Python version to test matrix

* Adds debug echo message

* Adds back Python 3.5.3 to test matrix

* Adds Python version to test matrix

* Adds back Python 3.5.3 to test matrix

* Adds Python 3.8 to test matrix
2019-12-12 14:57:52 +01:00
stevedodson
5a3c73ea54
Feature/info es fix (#99)
* Resolving inconsistent __repr__ test on python 3.5

* Fixing layout for info_es + adding Series.hist doc
2019-12-12 14:36:56 +01:00
stevedodson
4bb73215a0
Resolving inconsistent __repr__ test on python 3.5 (#98) 2019-12-12 12:51:29 +01:00
Michael Hirsch
79fdb1727e
Add Support for Series Histograms (#95)
* add support for series plotting
* update docs for series plotting support
* add tests for series plotting
* fix typo
* adds comment to ed_hist_series
2019-12-11 14:51:47 -05:00
Camilla
40a584dcc2
Adds build status sticker to README and runs test on different Python versions (#84)
* Adds build status sticker to README

* Adds Python version to test matrix

* Adds debug echo message

* Adds back Python 3.5.3 to test matrix
2019-12-11 15:41:34 +01:00
stevedodson
c5730e6d38
Feature/python 3.5 (#93)
* Adding python 3.5 compatibility.

Main issue is ordering of dictionaries.

* Updating notebooks with 3.7 results.

* Removing tempoorary code.

* Defaulting to OrderedDict for python 3.5 + lint all code

All code reformated by PyCharm and inspection results analysed.
2019-12-11 14:27:35 +01:00
stevedodson
9a2d55f3c8
Feature/pandas.0.25.3 (#92)
* Resolving pandas link

* Removing temporary file
2019-12-10 19:22:27 +01:00
stevedodson
e8a0fbb9f3
Feature/pandas.0.25.3 (#91)
* Added example notebooks + pytest for these notebooks1

* Fixed paths

* Fixing link in docs

* Minor update for pandas 0.25.3

* Updates for pandas 0.25.3

* Fixing doc links with pandas 0.25.3 update.

* Reverting overwrite to changes to notebooks.
2019-12-10 16:05:37 +01:00
stevedodson
133b227b93
Added example notebooks + pytest for notebooks (#87)
* Added example notebooks + pytest for these notebooks1

* Fixed paths

* Fixing link in docs

* Adding cleaner demo_notebook
2019-12-10 15:27:13 +01:00
stevedodson
206276c5fa
Adding Apache 2 copyright header to all .py files (#86) 2019-12-06 09:44:05 +00:00
stevedodson
f06219f0ec
Feature/refactor tasks (#83)
* Significant refactor of task list in operations.py

Classes based on composite pattern replace tuples for
tasks.

* Addressing review comments for eland/operations.py

* Minor update to review fixes

* Minor fix for some better handling of non-aggregatable fields: https://github.com/elastic/eland/issues/71

* Test for non-aggrgatable value_counts

* Refactoring tasks/actions

* Removing debug and fixing doctest
2019-12-06 08:46:43 +00:00
Michael Hirsch
f263e21b8a Better Handling of Non Aggregatable Fields (#85)
* updates ecommerce mapping to include non-aggregatable text field

* updates exists tests and adds new tests for non-aggregatable field

* better handling on non-aggregatable fields

* fixes formatting

* swaps series in assertion

* adds newline
2019-12-06 08:20:09 +00:00
Francesco Vigliaturo
99bfea42b6
Added support for 2 date formats: (#70)
* Adds support for multiple date formats
2019-12-04 17:42:50 +01:00
stevedodson
13141645f7
Merge pull request #82 from stevedodson/feature/fix_nested_not_filters
Feature/fix nested not filters
2019-12-03 15:32:31 +00:00
Stephen Dodson
1423aaad2d Adding minor fixes to last PR 2019-12-03 14:07:05 +00:00
Stephen Dodson
57857277cd Merge remote-tracking branch 'upstream/master' into feature/fix_nested_not_filters 2019-12-03 14:03:03 +00:00
Stephen Dodson
bf6c56878a Correcting license files + fixing bug in filter
LICENSE and NOTICE conform to Elastic policy. Bug in
nested negated filters fixed.

Also, some limited cleanup.
2019-12-03 13:56:49 +00:00
Camilla
b56588463c
Merge pull request #81 from Winterflower/pull-request-job
Refactors tests and adds config to fix SSL issue
2019-12-03 14:20:01 +01:00
Winterflower
3e82d43351 Merge branch 'pull-request-job' of https://github.com/Winterflower/eland into pull-request-job 2019-12-02 20:32:30 +01:00
Winterflower
10e1adb680 Removes code duplication in test code 2019-12-02 20:31:53 +01:00
Camilla
5a5f38e28a
Merge branch 'master' into pull-request-job 2019-12-02 20:26:10 +01:00
Winterflower
33674088ca Refactors eland tests to accept pre-configured client 2019-12-02 20:23:40 +01:00
Winterflower
9c15e237ca Adds env variable to pass test suite version into container 2019-12-02 20:22:07 +01:00
Camilla
4b2daa9ddc
Merge pull request #80 from Winterflower/pull-request-job
Adds Pull Request job for eland CI
2019-12-02 18:15:54 +01:00
Winterflower
7f8d384f03 Adds pull request CI job for eland 2019-12-02 17:29:17 +01:00
Winterflower
4e6305c24a Removes stripping of http from url 2019-12-02 17:29:17 +01:00
Winterflower
32cd181065 Adds pull request CI job for eland 2019-12-02 17:22:34 +01:00
Winterflower
8aadc33687 Removes stripping of http from url 2019-12-02 17:18:40 +01:00
Camilla
d3caf663c5
Merge pull request #77 from Winterflower/max-compilations-limit
Increase script.max_compilations_rate
2019-12-02 13:13:29 +01:00
Winterflower
08357126cb Adds function to increase script.max_compilations_rate to prevent test failures 2019-12-02 13:08:47 +01:00
Camilla
9e176f08f3
Merge pull request #75 from Winterflower/ci-setup
Fixes misconfigured env variable for CI setup
2019-12-02 11:54:21 +01:00
Winterflower
9571fcb2fa Fixes misconfigured env variable 2019-12-02 11:46:07 +01:00
Camilla
99ae4057f4
Merge pull request #61 from Winterflower/ci-setup
Eland CI Setup
2019-11-29 10:19:06 +01:00
Winterflower
beaf719201 Making run_build.sh executable 2019-11-29 08:58:31 +01:00
Winterflower
8a9e83d0e5 Removes line that sets run_build.sh as executable and adds Python versions to test_matrix.yml 2019-11-28 13:50:05 +01:00
Winterflower
78b4a2291b Drops default Python version of Dockerfile to 3.7, because Pandas 0.25.1 is not compatible with Python 3.8 and Pandas 0.25.2 is breaking some eland tests 2019-11-27 21:29:26 +01:00