Autoplot Application (20130709a)

Random screenshot.

Autoplot attempts to allow plotting of data from many data sources, including local files and OpenDAP servers. Datasets are identified with URIs, and by the URI's extension a module is used to load the data into the internal data model. Data is then displayed by guessing the rendering method and axis ranges to provide a reasonable, useful view of the data.

This is the Autoplot2013a branch. This is an update to the production version containing bugfixes and minor new features. Java 6 is now required.

Single-jar version, autoplot.jar, can be run without network access and from the command line. Note CDFs are only supported via the Java-based reader and Autoplot will attempt to use it when the C-based version is not available.

Bugfixes:

• Mike at LANL pointed out that |multiply(-2) wouldn't work.
• Export panel additional options was not properly disabled when there were no options, resulting in RTE.
• TT2000 metadata would be misinterpreted as code would convert metadata to doubles
• 1059: history.txt in headless mode, don't write to history during headless batch processing.
• completions in zip file systems would not work properly.
• .classpath file updated for use in Eclipse, thanks Jon.
• 1056: BackingStoreException caused by OptionsPrefsController
• 1055: Red flash sometimes visible on startup
• $v was not detected in URIs with ...v01.cdf
• 1050: problems with CDF files and RBSP data from GEM
• Move DateTimeDatumFormatter to das2 so APL can use it.
• 1054: make sure clearing cache doesn't clear keychain and ro_cache files.
• 1053: long process operations collapse and total have poor feedback.
• 1052: math with scalars and QDataSets.
• clear annotations in the Jython editor when new or load is pressed.
• rebin(ds,int,int) was inconsistent with IDL rebin command, change now before people start using it
• rte_1527677511: try/finally when reading .listing file.
• Slicers show up in different positions instead of always in the same position, which caused confusion.
• times would occasionally show up in CDAWeb interface twice (2013-02-052013-02-05)
• $v is ignored by default in the TimeParser. PngWalkTool was failing to add it
• off-by-one error in DataPointRecorder when selection was made at end of points.
• Seth noticed problem where slightly unconventional CDFs would no longer load because new code that allows missing units
• cdaweb fixes after RBSP data was added, including $(v,sep) and virtual variable for DEPEND_1 coming from master file.
• events renderer would occasionally fail because of race condition
• ISO8601 2013-04/2013-06 did not parse properly
• build up code that reduces rank2 DEPEND_1 in mageis data.
• minor bugs in reporting dimensions with CDF variables.
• bugfix in CDAWeb where virtual variable failure because missing component variable
• single-jar release would fail because of old signature.
• RTE in CDF reader would hang the reference cache it is was enabled.
• 1044: CDF slice1 was not properly implemented for rank 3 and rank 4 datasets.
• update RBSP orbit files
• 1042: plot command grabs focus
• 1041: don't create empty folders when folder names are mistyped
• 1038: copy plots down non-default renderType & parent plotElement
• 1040: rte_0739382963: java.lang.SecurityException...signer info
• reducePath of selection highlites improving responsiveness
• when a file wasn't found covering the interval, the timerange would jump out to one day, regardless of size.
• Thread deadlock was showing up in Hudson tests.
• OpenDAP error feedback improved while CDAWeb's OpenDAP server is currently down.
• bugfix labels in ascii tables when units contain * / and ^.
• refactorings to FFTPower so that ytags are only calculated once.

Older Bugfixes:

• Bob had a short list of bugs.
• Bugfix in QStream reduction when Join dataset is reduced.
• rte_1999763719: malformed CDF gave the impression problem was with Autoplot
• "24 hours" / "60 minutes" works properly now (=24)
• plot id changes are propagated through the rest of the vap.
• rfe 3596086: CDF Java implementation now implements slice1 to save memory

Features:

• add vap+orbit:rbspa-pp to make it more trivial to add annotations
• improvements to metadata in pngs to support thin clients.
• replicate( QDataSet, int ) introduced.
• add square and sawtooth wave functions. Add detrend for John B.
• PWD variable introduced to Jython scripts
• DatumRanges are convered to QDataSets in scripts.
• reduce createPngWalk stdout noise that was messing up batch processing at LANL.
• for eventListColumn, look for RGB-encoded color in text field in third column
• add copy menu item to metadata tab
• allow %{PWD} macro inside of .vap file to allow for more portable demos.
• QStreams support rank 2 DEPEND_1.
• Allow * and ? to be used in CDAWeb filter strings.
• TimeRangeTool is used in more places
• always bring up options dialog when tools have parameters.
• #308 ge and lt modifiers for version numbers in filename templates
• smoothFit function added, which is like smooth but does a fit at the edges.
• setLayoutOverplot added which makes a single plot with so many plotElements
• TimeRangeEditor shows an orbit based on the current time in its examples
• pngwalk now allows a list of times instead of a list based on the template
• preferred http://tsds.org/uri_templates dollar-paren notation is use internally for $(Y,span=5), was %{Y}.
• inline data source supports assignments, like vap+inline:t=linspace(0,2*PI,200)&cos(t*2),sin(t*3),t
• New ISO8601 range parser supports "2012-02-02T02:00/04:00"
• New timerange field types from http://tsds.org/uri_specification, including $x, hrinterval, subsec and periodic, shift
• Start list of open source components in help screen, report memory sizes in 1000*1000 byte units, not 1024*1024.

Less recent features:

• Metadata veiw of dataset checks for JoinDataSets so they can be inspected, cadence is reported for each joined dataset.
• interpolateGrid introduced, which performs rank 2 interpolation when for 1-D X and Y grid.
• add createEvent method to make it easy to create events datasets in scripts.
• add fft that supports slide and windows but still provides access to real and imaginary components.
• add setLayout and fixLayout commands to jython.
• add getElementById to application controller.

Known issues:

• see Source Forge

This completes the feature set for the new production branch. No major features will be added before branching this version. A production branch will be started in a couple of weeks, and the "Start Autoplot" link at the top of autoplot.org will run this version. Feedback on the function and quality of this release is greatly appreciated!

Data is input from:

• ASCII files (.dat,.txt)
• CSV files (.csv)
• Binary files (.bin)
• CDF files(.cdf)
• Excel spread sheets (.xls)
• das2Streams (.d2s or .das2Stream)
• ViRBO's TSDS server
• CDAWeb data server (vap+cdaweb:)
• das2servers (vap+das2server:)
• QStreams (.qds), QDataSet on a das2Stream
• Plasma Wave Group das2 Server
• NetCDF files (.nc,.ncml)
• HDF5 files (.h5,.hdf5)
• DODs servers (.dds)
• Cluster Exchange Format files (.cef)
• Fits Format Files
• Images (.jpg, .png, .gif)
• Wav audio files (.wav)

This is not complete, and limitations include:

• Quantities of rank 3 dimensionality (e.g. flux(Time,Energy,pitch) are plotted by slicing.
• Quantities of rank 4 dimensionality (e.g. flux(Time,Energy,azimuth,sector) are plotted by slicing twice.

autoplot.org is the wiki website, and contains more information than this launch page.