We had our monthly SeaFlow/eScience group meeting meeting. For this grant the oceanographers have been doing lots of new science using tools like SQLShare, Myria, and popcycle, our software for storing indexing and analyzing SeaFlow data. We discussed needed improvements to popcycle and to the seaflow-viz web dashboard (see it here https://uwescience.github.com/seaflow-viz) for visualizing cruise performance and science in real time. Sophie gave an update on the cruise she got back from a few weeks ago and on our work in the last two weeks analyzing cell diversity in Myria. Francois gave an update on the new proposal we submitted to analyze population dynamics in SeaFlow data. Thinking ahead, we talked about Jarred‘s agenda for scaling up SeaFlow data collection and what needs that would entail for automated instrument monitoring and the underlying data service; and we talked about how to demo “Myria for SeaFlow” to a broader audience.

In the rest of the day, I worked on making Raco better: adding some new optimization rules to streamline the types of plans that are emitted by the Flink compiler, and hacking/code reviewing with Brandon to get the MyriaL → Grappa support working better, and fixing a few little issues that cropped up.

I also finally implemented, evaluated, and deployed the 50x—100x speedup SQL query mod to the bottleneck query in Dominik‘s fantastic Myria profiler. Now the profiling UI is super-snappy even for long programs.