Autoplot Application (20171128a)

Old Autoplot splash screen uses slightly different yellow than new icon.

Autoplot attempts to allow plotting of data from many data sources, including remote CDF files and OpenDAP servers. Datasets are identified with URIs, and by the URI's extension, data are loaded into the internal data model. Data are then displayed by guessing the rendering method and axis ranges to provide a reasonable, useful view of the data. Data can then be additionally processed with other operations like smooth and FFT, and Jython scripting provides a capable programming environment.

This is the Autoplot2017a branch. This is an update to the production version containing bugfixes and minor new features. Java 7 is now required. Java 8 will be required sometime soon.

Single-jar version, autoplot.jar, can be run without network access and from the command line.

Mac DMG Release is available.

Bugfixes (2017-11-28 r21765):

• Data Mashup dialog add expression option properly removes human-readable label from "magnitude(x): the lengths of the vectors" and others.
• HAPI file caching failed to update download URL to include full days, resulting in partial cache files.
• trim( ds, t1,t2) handles when ds is length 1 or length 0. Thanks Ivar!
• 1924: Time Range mode allows local vap timerange to be edited, as you can with the URI selector.
• PngWalk properly decodes and encodes URIs, supporting spaces and brackets in file names.
• new cadence check of waveform data had a branch which would result in NullPointerException.
• run batch GUI new keeps track of events list GUI.
• valid(r3) where r3 had a BUNDLE_1, as with MagEIS data, would create an invalid result.
• Masafumi caught a case where new series symbol connector code was too restrictive on units.
• left vertical axis with tick labels turned off, failed to draw the ticks. Thanks, Masafumi!
• 1922: Jython script which hangs the Java session. Check for this condition and fix the situation by switching to a linear axis. Thanks, Masafumi!
• rte_0088023411: where subsetting a CDF which had non-time-varying data marked as time-varying caused RTE. Thanks, zhangzx!
• rte_0211810917: where single column ASCII files could not be read, and Sebastian's file triggered the same bug. Thanks, Sebastian!
• "Display Data" mouse module handles events data.
• file system names use / on Windows, in the cache tool.
• 2017 update of the signature for jar files. Thanks, Bernie!
• 1916: logic for working with POES dataset caused some breaks in Masafumi's data to be skipped.
• TrimDataSet trims BUNDLE_0, so that datumRange(evt[0:2]) can be used to easily get the time range.
• 1912: re-fix bug where trim would include extra point, this time without dependence on cadence. Thanks Ivar!
• recent changes in pdf support broke legacy pdf output. Thanks, Ivar and others for pointing this out!
• non-standard micro symbol was used for microseconds, making standard microseconds behave improperly and failure to render as waveform. Thanks, Chris!
• 1916: "NaN" parses to fill Datum for times. This supports breaks in timeseries. Thanks, Masafumi!
• 1912: new change to check cadence didn't properly consider conditions when issuing errors. Thanks, Ivar!
• 1913: data source editors shouldn't add extraneous question mark.

Older Bugfixes:

• 1888: corrections to Javadoc popup for packages, since Java 8 documentation changes this.
• export to wave checks timetags to make sure data is sorted. Thanks Masafumi!
• remove leftover binding between yaxis and FLIPCOLORBARLABEL, which could lead to memory leak.
• corrections to trim function, which now requires data be within cadence of bounds for it to be included.
• corrections to das2stream adapter which was incorrectly setting monotonic. Better handle second-checks of monotonic. Thanks, Masafumi!
• correction to ifft, which incorrectly reconstructed the timetags.
• metadata tab properly formats small numbers (0.00001) in a linear space, not "0.000". Thanks, Ivar!
• rfe601: temporarily remove scale bindings to v1.08 vap files, so that they can be loaded with old Autoplot versions.
• 1911: set canvas size would trigger the thumbnail generation, which reset the canvas size to its old size.
• Positive time zone offsets (+0600) where not parsed properly.
• Huge scatter mode has branch which was dropping the last record of a rank 2 waveform. Thanks, George!
• 1911: respect options.autorange=False. New autoranging code would always autorange.
• 1910: make sure that the script plot command sets the immutable flag so that plot operates as expected and copying the data can be avoided. Thanks, Masafumi!
• George pointed out where rank 3 waveform data would drop records.
• ASCII files starting with two time columns could only be read as events, so column keyword didn't work.
• UriTcaSource tweaked to provide useful method for sampling data from URI.
• correction to TimeParser.normalizeTimes, which would improperly round resulting in .699999. Thanks, Masafumi!
• DataPointRecorder had a time resolution limit that prevented use with waveform data. Thanks, Sadie!
• 1793: CSV automatically switchies to semicolon, and allows long headers. Thanks Chris and Bill!
• 1902: improvements to pngwalk tool's write to html.
• 1905: ascii table data source depend1Values were dropped. Thanks, Victor!
• deselecting "bundle" on the ascii editor would not remove bundle keyword from URI.
• 1897: tests needed for autoRangeHints.
• 1899: add and subtract operators to allow sloppiness with units.
• add a couple of completions for timerange and plots[0].yaxis.range to vap file completions after the question mark (?).
• support colorLoadOrder.vap?plots[0].yaxis.range='0+to+4'
• 1895: when rendererControl and color properties are inconsistent, let specific property override.

Features:

• Add "blur focus" to layout to aid in debugging.
• SAMP support supports messages with das2server URLs.
• HAPI editor reports lastModified, if available.
• plot has xtickValues and ytickValues. Thanks, Masafumi!
• new autoplot_test099 allows for testing of private vaps by obfuscating tests.
• plot has symbolFill named parameter, rightAxisOf added. Thanks, Masafumi!
• Jython plot command returns tuple of (plot,plotElement). Thanks, Masafumi!
• Run Batch will print a png or pdf after each iteration.
• Introduce experimental client-side caching to the HAPI support.
• add getNextIndexStrict and getPreviousIndexStrict.
• new Autoplot icons!
• rfe609: add experimental HAPI client-side caching.
• rfe548: Jython plot command now accepts renderer, so that scripts can easily add custom renderers.
• create pngwalk tool has mode where the running Autoplot is used to generate the images, not a copy, to aid with debugging and to allow decorations.
• complexMultiply promotes rank, supporting (0+1j) * complex array.
• orbit files can now have more than three columns, where the last column is used as the label, to be more consistent with events files. Thanks Ivar!
• invokeScriptSoon allows parameters in URI, to improve usefulness to Jython scripts.
• begin support for new polar plotting mode.
• DataPointRecorder allows fill records to be inserted. Thanks Masafumi!
• Jython completions show last assignment of variable names

Less recent features:

• prepare HAPI client for upcoming changes to HAPI spec, where units and label can be arrays.
• rfe603: refactor AutoplotUtil to extract AutoRangeUtil, which is just the Autoranging codes.
• improvements to cadence calculation for waveform datasets.
• eventsConjunction function returns where two events lists have overlaps.
• print to PDF now has pixels per inch and (finally) overall width controls.
• rfe601: new scale property allows axis scales to be bound.
• tweaks to property editor so it can be used to show the DOM with updates.
• toDegrees and toRadians now set the units.
• DatumRangeUtil's time range parser properly throws parse exception with "0 to 4" (or any year<1000.)
• PNGWalk save as has checkbox to reduce the image by 60%, to save time in releases.
• "Run Batch" allows times to be loaded from events file.

Known issues:

• see Source Forge
• Bugs often have a four-digit ID and can be reviewed with https://sourceforge.net/p/autoplot/bugs/<ID>/.
• Features typically have a three-digit ID and can be reviewed with https://sourceforge.net/p/autoplot/feature-requests/<ID>/.

This completes the feature set for the new production branch. No major features will be added before branching this version. A production branch will be started in a couple of weeks, and the "Start Autoplot" link at the top of autoplot.org will run this version. Feedback on the function and quality of this release is greatly appreciated!

Data is input from:

• ASCII files (.dat,.txt)
• CSV files (.csv)
• Binary files (.bin)
• CDF files(.cdf)
• Excel spread sheets (.xls)
• das2Streams (.d2s or .das2Stream)
• ViRBO's TSDS server
• CDAWeb data server (vap+cdaweb:)
• das2servers (vap+das2server:)
• QStreams (.qds), QDataSet on a das2Stream
• Plasma Wave Group das2 Server
• NetCDF files (.nc,.ncml)
• HDF5 files (.h5,.hdf5)
• DODs servers (.dds)
• Cluster Exchange Format files (.cef)
• Fits Format Files
• Images (.jpg, .png, .gif)
• Wav audio files (.wav)

This is not complete, and limitations include:

• Quantities of rank 3 dimensionality (e.g. flux(Time,Energy,pitch) are plotted by slicing.
• Quantities of rank 4 dimensionality (e.g. flux(Time,Energy,azimuth,sector) are plotted by slicing twice.

autoplot.org is the wiki website, and contains more information than this launch page.