The newest Chrome update broke parts of Myria because of new policies regarding security (HTTPS) in web API calls. So, I finally did the 5 hours of work it would take to make Myria’s API server support HTTPS, installed the certificate, and made all our deployment scripts. Now our users’ data (which is all publicly logged anyway) is much “safer” and, more importantly, the website works again.

I sat down with the ethnographers who are observing the Data Science Incubator — Brittany Fiore-Silvast and Anissa Tanweer — to chat about the parts of the Incubator process that happened before we looped them in. We discussed the internal planning, what happened in Spring and what we wanted to change, the applicant pool, the review process, and more. It was a fun chat and merely having the chat, plus their insightful questions, made me reflect more on the process and take a step back.

Bill Howe and I met with Shrainik Jain and Dominik Moritz to discuss our project quantifying how much “variety” there is in different data systems and progress on the draft paper they have been writing. The basic idea is that we have an intuitive notion of “well-structured” databases (like the TPC benchmarks), and databases with “high variety” (like SQLShare), and we ought to be able to quantitatively find differences between them. SDSS should be a nice mid-point: it has many users asking potentially different questions, but their queries are limited to a well-defined, highly structured schema provided by the Skyserver team. Initial results are promising, and we are starting to put together a draft.

Other articles

2014-09-16 daily
Published: Tue 16 September 2014
By Daniel Halperin

In daily.

tags: incubator myria andrew bill sandra jevin

I also did not get much time to do real work today. There were three major activities:
1. UW Data Science Incubator applications are due Thursday! They have started rolling in, so I have started looking at them and have started a few clarifying discussions with some of the authors. Getting ...
read more
There are comments.
2014-09-12 daily

Published: Fri 12 September 2014
By Daniel Halperin

In daily.

tags: myria andrew bill brandon jevin magda sandra

Tomorrow I will work more on the scaling issues!

We had a great Myria meeting this afternoon. We discussed Andrew Whitaker‘s user-defined aggregate (UDA) extensions to MyriaL, which provide a very nice way to get scalable, distributed partial aggregation to implement many complicated aggregations in a single scan rather ...
read more
There are comments.
2014-08-28 daily

Published: Thu 28 August 2014
By Daniel Halperin

In daily.

tags: myria raco seaflow andrew bill brandon dominik francois jarred sophie

We had our monthly SeaFlow/eScience group meeting meeting. For this grant the oceanographers have been doing lots of new science using tools like SQLShare, Myria, and popcycle, our software for storing indexing and analyzing SeaFlow data. We discussed needed improvements to popcycle and to the seaflow-viz web dashboard (see ...
read more
There are comments.
2014-08-27 daily

Published: Wed 27 August 2014
By Daniel Halperin

In daily.

tags: flink incubator asterios stephan andrew bill jake joe

I began the day with a Skype call with Asterios and Stephan from the Flink team. I learned some more things about how to use and test the code I write for Flink, and several places where I did not quite understand the low-level Flink behavior. I have a long ...
read more
There are comments.

Other articles

blogroll

social