Changelog

version 3.002 (2020-04-17)

bugfixes:

• fixed flagging of invalid values for parameters U and V in data summary plots (Sabine Schroeder s.schroeder@fz-juelich.de)
• eliminated python2.7 relicts in ozone metrics:
  • drmdmax1h: 'long' --> 'int' (Sabine Schroeder s.schroeder@fz-juelich.de)
  • w90: 'rolling_apply' --> 'rolling.apply' (Sabine Schroeder s.schroeder@fz-juelich.de)

changes:

• created constant links for
  • data-protection (https://join.fz-juelich.de/static/documentation/data-protection.html) and (Sabine Schroeder s.schroeder@fz-juelich.de)
  • legal-notice (https://join.fz-juelich.de/static/documentation/legal-notice.html) (Sabine Schroeder s.schroeder@fz-juelich.de)
• REST:
  • search accepts daterange keyword (Sabine Schroeder s.schroeder@fz-juelich.de)
  • no data available ==> returns only metadata (empty data, added error message) (Sabine Schroeder s.schroeder@fz-juelich.de)
  • use new template 500.html (Sabine Schroeder s.schroeder@fz-juelich.de)

version 3.001 (2019-05-24)

python3 version -- same functionality as version 2.033 (python2)

bugfixes:

• fixed sign error in Mann-Kendall (MK) test (Sabine Schroeder s.schroeder@fz-juelich.de)

changes :

• added changelog-feature (Sabine Schroeder s.schroeder@fz-juelich.de)
• restore data access filter status only, if join version did not change since last login (delete cookies from older join version) (Sabine Schroeder s.schroeder@fz-juelich.de)

version 2.033 (2019-03-22)

bugfixes:

• all statistics and plots are done in solar_time both in the JOIN as in the REST interface (Sabine Schroeder s.schroeder@fz-juelich.de)

changes :

• eliminated time-conversion selection from the JOIN interface (Sabine Schroeder s.schroeder@fz-juelich.de)

version 2.032 (2018-08-06)

bugfixes:

changes :

• Updated data protection statement, now as separate footer link (Martin G. Schultz m.schultz@fz-juelich.de)

version 2.031 (2018-07-16)

bugfixes:

• Bug fix for summertime statistics (were reported as DJF, MAM, JJA, and SON) (Martin G. Schultz m.schultz@fz-juelich.de)
• Changed calculation of solar time to use np.floor instead of round (Martin G. Schultz m.schultz@fz-juelich.de)

changes :

• Updated data privacy statement according to new EU regulation (Martin G. Schultz m.schultz@fz-juelich.de)
• Updated data privacy statement: auto-delete user accounts after 18 months (Martin G. Schultz m.schultz@fz-juelich.de)
• Update doi url in data_access.html (Rajveer Saini r.saini@fz-juelich.de)
• Fixed remaining deprecation warnings
  basemap/matplotlib warning remains - would need a new basemap version (Martin G. Schultz m.schultz@fz-juelich.de)
• Replaced jquery.cookies with js.cookies (keep old JQuery version - mini change in index.html) (Martin G. Schultz m.schultz@fz-juelich.de)
• changed callback to google maps (Martin G. Schultz m.schultz@fz-juelich.de)
• updated highstock js library (including version comment in About box) (Martin G. Schultz m.schultz@fz-juelich.de)
• removed deprecated how= in resample of ozone_metrics.py and removed debug print statements in views.py (Martin G. Schultz m.schultz@fz-juelich.de)
• Cleanup of javascript libraries in home and libs, added JS version numbers to About (Martin G. Schultz m.schultz@fz-juelich.de)
• Added save_(filter)_status to ApplyFilters (Martin G. Schultz m.schultz@fz-juelich.de)
• Fixed deprecation warnings (pandas) (Martin G. Schultz m.schultz@fz-juelich.de)
• Added sponsor logos (Martin G. Schultz m.schultz@fz-juelich.de)

version 2.030 (2017-10-23)

bugfixes:

• Another CustomEncoder bug fixed which prevented REST stats with statistics=minimum to work (and probably others). Reason: data type for pandas timeseries index changed (Martin G. Schultz m.schultz@fz-juelich.de)
• Fixed min and max bug in statistics processing (Martin G. Schultz m.schultz@fz-juelich.de)
• Bug fix that prevented JOIN from running with newer numpy versions: JSON CustomEncoder needed to include a np.datetime64 branch (Martin G. Schultz m.schultz@fz-juelich.de)

changes:

• Improved data_access page template with logos and links to data providers; also added link to re3data badge. (Martin G. Schultz m.schultz@fz-juelich.de)
• changed window.location redirect so that it should now also work with Chrome (added href) (Martin G. Schultz m.schultz@fz-juelich.de)
• replace pd.rolling_mean by DataFrame.rolling(...).mean() on two more spots (Rajveer Saini r.saini@fz-juelich.de)
• pandas Dataframe.order no longer worked with new packages; has been replaced by Dataframe.sort_values(). Fixes Issue #5. (Martin G. Schultz m.schultz@fz-juelich.de)
• use intern base url instead join.fz-juelich.de for the rest service (Rajveer Saini r.saini@fz-juelich.de)
• update home and data access page (Rajveer Saini r.saini@fz-juelich.de)
• Restructured and updated requirements.txt - now uses >= instead of == for package versions and includes comments (Martin G. Schultz m.schultz@fz-juelich.de)
• Modified data access text including data policy (Martin G. Schultz m.schultz@fz-juelich.de)
• Changed data access html template: removed everything except TOAR database access (Martin G. Schultz m.schultz@fz-juelich.de)

version 2.020 (2017-10-12)

bugfixes:

• station metadata to be displayed again (Rajveer Saini r.saini@fz-juelich.de)

changes:

• update requirements file, pandas is downgraded to 0.16.2. (Martin G. Schultz m.schultz@fz-juelich.de)
• Remove repeat password label, it does not work in new django (Rajveer Saini r.saini@fz-juelich.de)
• Added max and min to statistics (Martin G. Schultz m.schultz@fz-juelich.de)
• Add migrations (result from makemigrations accounts data_access home) (Martin G. Schultz m.schultz@fz-juelich.de)
• Change button label (Martin G. Schultz m.schultz@fz-juelich.de)
• In django 1.9 the url tag is loaded by default so remove %load url from future%" (Rajveer Saini r.saini@fz-juelich.de)
• The context_instance parameter in render_to_response was deprecated in Django 1.8, and removed in Django 1.10. Use render instead (Rajveer Saini r.saini@fz-juelich.de)
• REST service: station_name search is now case-insensitive (Rajveer Saini r.saini@fz-juelich.de)
• join/apps/databases/obs_surface_stations/obs_stations_database.py: added translations of TOAR_CATEGORY, HTAP_REGIONX, ALT_FLAG, COORDINATE_STATUS, LANDCOVER in "join_get_stations_and_series_info" (to be able to do queries with value OR key) enabled use of UTF-8 encoding for station_name in "_where" (Sabine Schroeder s.schroeder@fz-juelich.de)
• join/apps/databases/obs_surface_stations/obs_stations_database_flags.py: redefine values for COORDINATE_STATUS, ALT_FLAG, CLIMATIC_ZONE, LANDCOVER, HTAP_REGIONX, TOAR_CATEGORY (not containing blanks, commas, or other special characters) (Sabine Schroeder s.schroeder@fz-juelich.de)
• the REST interface can now deal with requests giving a range for 'station_reported_alt', 'station_google_alt', 'station_etopo_alt', 'station_etopo_relative_alt', and 'station_population_density' (Sabine Schroeder s.schroeder@fz-juelich.de)
• the REST interface can now process queries given either value or key for 'station_coordinate_status', 'station_alt_flag', 'station_climatic_zone', 'station_landcover', 'station_htap_region', 'station_htap_regionx', 'station_toar_category' (Sabine Schroeder s.schroeder@fz-juelich.de)
• updated documentation for the REST interface (Sabine Schroeder s.schroeder@fz-juelich.de)

version 2.019 (2017-05-18)

bugfixes:

changes:

• upgraded django packages and some other modules (Rajveer Saini r.saini@fz-juelich.de)
• changed the message at the bottom of the window from "Displaying x1 data series out of x at y1 stations out of y" to "Found x1 data series out of x at y1 stations out of y", because this is more precise. (Sabine Schroeder s.schroeder@fz-juelich.de)
• corrected typo 'boundary_box' -> 'boundingbox' in REST interface (Sabine Schroeder s.schroeder@fz-juelich.de)
• new version of method 'update_views' (now known as: 'display_filtered_stations') (Sabine Schroeder s.schroeder@fz-juelich.de)
• new version of 'search' (splitted into two parts: 'compose_search_query' und 'execute_search_query' (Sabine Schroeder s.schroeder@fz-juelich.de)

version 2.018 (2017-05-05)

bugfixes:

changes:

• REST interface: adapted date values, default format json for stats,i improved error messages (Sabine Schroeder s.schroeder@fz-juelich.de)

version 2.017 (2017-04-26)

bugfixes:

changes:

• optimized access time to first page of surface data at login (Sabine Schroeder s.schroeder@fz-juelich.de)

version 2.016 (2017-04-13)

bugfixes:

• fixes in statistics/ozone_metrics methods (Sabine Schroeder s.schroeder@fz-juelich.de)
• fixes in REST interface (Sabine Schroeder s.schroeder@fz-juelich.de)

changes:

• new, updated and fixed statistics/ozone_metrics methods (Sabine Schroeder s.schroeder@fz-juelich.de)
• updated and fixed rest interface (plus online documentation) (Sabine Schroeder s.schroeder@fz-juelich.de)
• optimized database calls retrieving station information (Sabine Schroeder s.schroeder@fz-juelich.de)

version 2.015 (2016-06-27)

bugfixes:

changes:

• show station-id, network-name, station-name, parameter-pi, and parameter-pi-email in data extraction window (Sabine Schroeder s.schroeder@fz-juelich.de)
• new, updated and fixed statistics/ozone_metrics methodsA (Sabine Schroeder s.schroeder@fz-juelich.de)
• uses splitted obs_stations_database.py (no admin tools available for JOIN application!) (Sabine Schroeder s.schroeder@fz-juelich.de)
• new proxy filters implemented (Sabine Schroeder s.schroeder@fz-juelich.de)

version 2.014 (2016-06-17)

bugfixes:

changes:

• a list of numids can be given to the REST interface (Sabine Schroeder s.schroeder@fz-juelich.de)

version 2.013 (2016-06-16)

bugfixes:

• fix for _where-method, if station exists, but no parameter_series available (Sabine Schroeder s.schroeder@fz-juelich.de)

changes:

• get_parameter_series_id: change keyword 'station' to 'station_numid' (Sabine Schroeder s.schroeder@fz-juelich.de)

version 2.012 (2016-05-19)

bugfixes:

changes:

• updated Map Marker Cluster Image Path to GitHub (Sabine Schroeder s.schroeder@fz-juelich.de)
• new database fields station_toar_category, station_relative_alt and station_htap_region are useable (Sabine Schroeder s.schroeder@fz-juelich.de)
• improvements on REST interface improved (Sabine Schroeder s.schroeder@fz-juelich.de)

version 2.011 (2016-04-15)

bugfixes:

• fixes in qa_analysis und qa_plot1 (Martin G. Schultz m.schultz@fz-juelich.de)

changes:

• added omi_no2_column (Sabine Schroeder s.schroeder@fz-juelich.de)
• added "more restrict" statistics (Martin G. Schultz m.schultz@fz-juelich.de)
• fixes in obs_stations_database.py (including a new decorator to avoid SQL injections) (Martin G. Schultz m.schultz@fz-juelich.de)
• modified write_ascii.py (Sabine Schroeder s.schroeder@fz-juelich.de)
• other filter settings (less explicit) in static/data_access/js/database_access.js (Sabine Schroeder s.schroeder@fz-juelich.de)
• embargoed data are now allowed to be shown in the data summary plot (Sabine Schroeder s.schroeder@fz-juelich.de)

version 2.010 (2016-03-24)

bugfixes:

• minor ones: returning empty dataframe, labeling of plots with more than one line, ... (Sabine Schroeder s.schroeder@fz-juelich.de)
• JOIN works now with species that don't provide a parameter_cf_standard_name like Ox, parameter_name filtering matches exactly (no NOx matches, if looking for Ox...), ...) (Sabine Schroeder s.schroeder@fz-juelich.de)

changes

• added filters and queries for the new proxy data station_wheat_production, station_rice_production, and station_no2_emissions (Sabine Schroeder s.schroeder@fz-juelich.de)
• changed proxy filters for station_population_density, station_nightlight from two numeric min/max filters to one range filter (Sabine Schroeder s.schroeder@fz-juelich.de)
• first preparations for REST interface (Sabine Schroeder s.schroeder@fz-juelich.de)
• summer (NH/SH) statistics and plots available (Sabine Schroeder s.schroeder@fz-juelich.de)
• added Mann-Kendall (MK) test (Mann 1945, Kendall 1975, Gilbert 1987) (Martin G. Schultz m.schultz@fz-juelich.de)
• improved data summary plot to fit also other species than O3 (also don't do too much filtering hidden from the user!) (Sabine Schroeder s.schroeder@fz-juelich.de)
• added more statistics (Martin G. Schultz m.schultz@fz-juelich.de)

version 2.009 (2016-02-19)

bugfixes:

changes:

• added write_ascii.py (Sabine Schroeder s.schroeder@fz-juelich.de)
• seasonal statistics and plots available (with nice legends) (Martin G. Schultz m.schultz@fz-juelich.de)
• restricted plot of hourly values to one year (Martin G. Schultz m.schultz@fz-juelich.de)

version 2.008 (2016-02-18)

bugfixes:

changes:

• added TOAR proxies' filters for stations (Sabine Schroeder s.schroeder@fz-juelich.de)
  a) min_population_density_02deg
  b) max_population_density_02deg
  c) min_nightlight_02deg
  d) max_nightlight_02deg
  e) climatic_zone
• introduced new filter type "yearlength" (Sabine Schroeder s.schroeder@fz-juelich.de)
• set parameter_name to 'o3' when starting to work with JOIN (Sabine Schroeder s.schroeder@fz-juelich.de)
• got rid of cdm_fix module (Sabine Schroeder s.schroeder@fz-juelich.de)

version 2.007 (2016-01-28)

bugfixes:

• fixed showing "Sorry, this site is under development!", if user selects an improper timerange (Sabine Schroeder s.schroeder@fz-juelich.de)

changes:

• introduce handling of embargoed data (parameter_status=1): (Sabine Schroeder s.schroeder@fz-juelich.de)
  • show stations on map
  • don't display any data of these serieses
  • inform user to contact dataset PI
• rename "QA plot" to "Data Summary" (Sabine Schroeder s.schroeder@fz-juelich.de)
• handle data from tables '*monthly' (Sabine Schroeder s.schroeder@fz-juelich.de)

version 2.006 (2015-12-04)

bugfixes:

• qa_plot: now everything also works fine if data stops before 1990 (Sabine Schroeder s.schroeder@fz-juelich.de)

changes:

• added population_density filters for stations (Sabine Schroeder s.schroeder@fz-juelich.de)

version 2.005 (2015-11-25)

bugfixes:

changes:

• show (second) altitude axis on vert_profile plots (Sabine Schroeder s.schroeder@fz-juelich.de)

version 2.004 (2015-11-13)

bugfixes:

• fixes for plotting IAGOS data

changes:

• changed download header tags (database_creation_date, database_modification_date, database_data_start_date, database_data_end_date) (Sabine Schroeder s.schroeder@fz-juelich.de)
• set slider range correctly from min to max; slider values shown in formatted way (Sabine Schroeder s.schroeder@fz-juelich.de)
• updated of IAGOS links (Sabine Schroeder s.schroeder@fz-juelich.de)
• prepared cdm access from outside (for IAGOS/HALO data) (Martin G. Schultz m.schultz@fz-juelich.de)
• added download tool for metrics data (Sabine Schroeder s.schroeder@fz-juelich.de)
• updated qa-plot (don't say "winter", but "DJF") (Martin G. Schultz m.schultz@fz-juelich.de)

version 2.003 (2015-10-02)

bugfixes:

• fixed inconsistency in data filter for station_id (Sabine Schroeder s.schroeder@fz-juelich.de)
• fixed resolving of regular expression in data filter for station_name (Sabine Schroeder s.schroeder@fz-juelich.de)
• cleaned up google map controls
• fixed units and parameter names in QA plots and statistics plots

changes:

• JOIN now remembers map settings in cookies

version 2.002 (2015-09-18): first release of JOIN (Juelich Open Web Interface)