{"id":20472,"date":"2021-12-08T10:23:17","date_gmt":"2021-12-08T15:23:17","guid":{"rendered":"https:\/\/www.bloomberg.com\/company\/stories\/ipydatagrid-adds-interactive-data-grids-to-the-jupyter-ecosystem\/"},"modified":"2023-04-03T10:08:13","modified_gmt":"2023-04-03T14:08:13","slug":"ipydatagrid-adds-interactive-data-grids-to-the-jupyter-ecosystem","status":"publish","type":"post","link":"https:\/\/www.bloomberg.com\/company\/stories\/ipydatagrid-adds-interactive-data-grids-to-the-jupyter-ecosystem\/","title":{"rendered":"ipydatagrid adds interactive data grids to the Jupyter ecosystem"},"content":{"rendered":"
\n \n\t\n\t\n\t
\n\t\t\n\t\t\t
\n\t
\n \n

Software engineers at Bloomberg often create tools that solve problems related to cloud infrastructure, information retrieval, data science, natural language processing, mobile application development, and more. A number of these tools have been published on GitHub<\/a> as open source projects for others across the tech industry to use in solving real-world problems. Several of the open source projects born at Bloomberg have also been spun out and are now supported by communities with their own governance.<\/em><\/p>\n

In this article, we talk with Itay Dafna, one of the developers of ipydatagrid<\/code><\/a>, an interactive data table widget for the Jupyter ecosystem, to learn more about this open source project:<\/em><\/strong><\/p>\n\n<\/div>\n

\n \"Siftware\"Siftware\n
Siftware engineer Itay Dafna<\/figcaption>\n<\/figure>\n
\n \n

Briefly tell us about yourself.<\/h3>\n

My name is Itay Dafna and I am a Software Engineer in Bloomberg\u2019s San Francisco Engineering Office<\/a>, where I work on the BQuant Visualizations team. I joined Bloomberg eight years ago after completing my master\u2019s degree in management. I have had the privilege to move between different departments whilst at Bloomberg – starting in Analytics, then Financial Engineering, where I tackled complex inquiries from our clients, and now Engineering. I also earned my Certificate in Quantitative Finance<\/a> while working for the company.<\/p>\n

Most of my work is \u201cfull stack\u201d and typically revolves around the Jupyter<\/a> ecosystem, specifically Jupyter-widgets. I am a maintainer of the popular ipywidgets<\/code> package, as well as bqplot<\/code><\/a> and, of course, ipydatagrid<\/code>. In some of the other projects I work on, I also get to apply my finance knowledge and leverage bleeding-edge technologies like WebAssembly (WASM).<\/p>\n

Tell us about the new open source project that was published.<\/h3>\n

As the name suggests, ipydatagrid<\/code> is a data grid Jupyter-widget. A data grid is essentially a grid of cells, much like Microsoft Excel, that holds tabular information (hierarchical, in some cases) and allows for quick analysis with filtering, sorting, and formatting based on some conditions. ipydatagrid<\/code> is a complete data grid solution and the first Jupyter-widget based one that allows for two-way data binding – any edits made on the UI get trickled down to the Python model, and vice versa.<\/p>\n\n<\/div>\n

\n \"Sample\"Sample\n
Sample data grid<\/figcaption>\n<\/figure>\n
\n \n

How did you come to work on this project? Who else has contributed?<\/h3>\n

The project was initiated by Kaia Young, my Team Lead, and Mehmet Bektas, a Jupyter core developer, with help from QuantStack\u2019s Martin Renou. By the time I joined the team, the project was released to Bloomberg clients only via the BQuant platform. As an early BQuant user, I always relied on data grids when building apps, so you can imagine my excitement when I joined the team and was offered the opportunity to contribute to ipydatagrid<\/code>.<\/p>\n

What did you individually contribute to the project?<\/h3>\n

In preparing to release the project to the OSS community, I worked with Bloomberg\u2019s Python Guild, JavaScript Guild, and Open Source Program Office (OSPO) to refactor the code base so that it was ready for publication. I also added numerous enhancements to the product, with notable examples being nested hierarchies of columns and rows, conditional formatting based on sibling cells, styling and themes, text wrapping, and automatic column-width fitting. Adding a new feature to ipydatagrid<\/code> is trickier than other products because it is built on top of other packages from the Jupyter ecosystem. So, a typical feature request in ipydatagrid<\/code> requires enhancements to happen upstream before they can be added to ipydatagrid<\/code> itself.<\/p>\n

How did your experience\/background prepare you to make this contribution?<\/h3>\n

I have a strong affinity for mathematics, especially quantitative finance and machine learning. The first stage of working with ML models is data exploration – understanding the data is crucial for determining the correct model to use. Being able to quickly filter, transform and format the data can be tremendously helpful in that phase. ipydatagrid<\/code> excels at making it easy to explore tabular data sets. Plus, because ipydatagrid<\/code> is a jupyter-widget, it is easy to link it with a plotting library like bqplot<\/code> so that when you click on a given numerical data column, a histogram plot is rendered, for example. ipydatagrid<\/code> can also be used to display portfolio weights, trading strategy backtest results, and to visualize asset scoring models.<\/p>\n

In my previous role with our Financial Engineering team, I was an early BQuant user and regularly used an older, less-capable data grid, which ipydatagrid<\/code> has now replaced. So I benefitted not only from knowing how to make the most out of data grids, but also what ipydatagrid<\/code> needs to reach feature parity (and beyond) with other data grid solutions.<\/p>\n

What problems does this solution solve inside Bloomberg?<\/h3>\n

A large base of our clients is used to working with tabular data. A vast majority of those who are using BQuant will have migrated their analyses from Excel. Having that familiar view of cells containing data inside BQuant has helped us bridge that large user experience gap and ease adoption of our new analytics platform for quantitative analysts and data scientists in the financial markets. ipydatagrid<\/code> also introduces enhanced functionality such as two-way data binding, different cell renderers, and conditional formatting based on the Vega Expression grammar, allowing for the creation of really sophisticated data grids with a user experience similar to Excel. In fact, before ipydatagrid<\/code> existed, many of our clients resorted to constructing their own data grids using HTML tables and CSS. ipydatagrid<\/code> ensures standardization when it comes to data grids in the Jupyter ecosystem.<\/p>\n\n<\/div>\n

\n \"ipydatagrid\"ipydatagrid\n
ipydatagrid implemented within BQuant<\/figcaption>\n<\/figure>\n
\n \n

How does this solution benefit the broader open source community?<\/h3>\n

There were a few attempts at creating a free-to-use Jupyter-widget data grid, but most efforts either lacked basic functionality, such as two-way data binding, or were abandoned by the community due to a lack of maintenance. ipydatagrid<\/code> provides the broader Jupyter community with a fast, robust and feature-complete data grid solution. Because ipydatagrid<\/code> is based on the Lumino package — a core package used in many JupyterLab extensions — most enhancements we add to ipydatagrid<\/code> are first added to that package before they\u2019re exposed in ipydatagrid<\/code>. So you have this ripple effect.<\/p>\n

What do you hope the community contributes to the project?<\/h3>\n

I hope ipydatagrid<\/code> becomes the de-facto data grid solution in the Jupyter ecosystem and that users get involved by contributing enhancements and fixes. We are doing so much to engage the community by being very responsive to issues raised on the repo, as well as providing help to community members who author pull requests.<\/p>\n\n<\/div>\n\n<\/div>\n\n\n\t\t\n\t<\/div>\n<\/div>\n\n","protected":false},"excerpt":{"rendered":"

A conversation about ipydatagrid with Itay Dafna, one of the developers of the open source interactive data table widget for the Jupyter ecosystem<\/p>\n","protected":false},"author":184,"featured_media":18759,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1466],"tags":[1619,1682,1683,1418,1472,1488,1685,1684,1486,1580,1464,1686,2033,1544,1601,1524,1521,1530],"class_list":["post-20472","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tech-at-bloomberg","tag-bqplot","tag-cloud","tag-cloud-infrastructure","tag-data","tag-data-science","tag-mobile","tag-mobile-application","tag-mobile-apps","tag-natural-language-processing","tag-nlp","tag-open-source","tag-quantitative-finance","tag-san-francisco","tag-senior-software-engineer","tag-software","tag-software-engineer","tag-software-engineering","tag-software-engineers"],"yoast_head":"\nipydatagrid adds interactive data grids to the Jupyter ecosystem | Bloomberg LP<\/title>\n<meta name=\"description\" content=\"Itay Dafna, a developer of the open source ipydatagrid project, discusses the creation of this interactive data table widget for the Jupyter ecosystem.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.bloomberg.com\/company\/stories\/ipydatagrid-adds-interactive-data-grids-to-the-jupyter-ecosystem\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"ipydatagrid adds interactive data grids to the Jupyter ecosystem | Bloomberg LP\" \/>\n<meta property=\"og:description\" content=\"Itay Dafna, a developer of the open source ipydatagrid project, discusses the creation of this interactive data table widget for the Jupyter ecosystem.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.bloomberg.com\/company\/stories\/ipydatagrid-adds-interactive-data-grids-to-the-jupyter-ecosystem\/\" \/>\n<meta property=\"og:site_name\" content=\"Bloomberg L.P.\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/bloomberglp\/\" \/>\n<meta property=\"article:published_time\" content=\"2021-12-08T15:23:17+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-04-03T14:08:13+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/assets.bbhub.io\/company\/sites\/51\/2021\/12\/image1.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1402\" \/>\n\t<meta property=\"og:image:height\" content=\"598\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"chaas30\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/assets.bbhub.io\/company\/sites\/51\/2021\/12\/image1.png\" \/>\n<meta name=\"twitter:creator\" content=\"@bloomberg\" \/>\n<meta name=\"twitter:site\" content=\"@bloomberg\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"chaas30\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.bloomberg.com\/company\/stories\/ipydatagrid-adds-interactive-data-grids-to-the-jupyter-ecosystem\/\",\"url\":\"https:\/\/www.bloomberg.com\/company\/stories\/ipydatagrid-adds-interactive-data-grids-to-the-jupyter-ecosystem\/\",\"name\":\"ipydatagrid adds interactive data grids to the Jupyter ecosystem | Bloomberg LP\",\"isPartOf\":{\"@id\":\"https:\/\/www.bloomberg.com\/company\/#website\"},\"datePublished\":\"2021-12-08T15:23:17+00:00\",\"dateModified\":\"2023-04-03T14:08:13+00:00\",\"author\":{\"@id\":\"https:\/\/www.bloomberg.com\/company\/#\/schema\/person\/4d4a18aae79d6fcc1ea98181a906905e\"},\"description\":\"Itay Dafna, a developer of the open source ipydatagrid project, discusses the creation of this interactive data table widget for the Jupyter ecosystem.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.bloomberg.com\/company\/stories\/ipydatagrid-adds-interactive-data-grids-to-the-jupyter-ecosystem\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.bloomberg.com\/company\/stories\/ipydatagrid-adds-interactive-data-grids-to-the-jupyter-ecosystem\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.bloomberg.com\/company\/stories\/ipydatagrid-adds-interactive-data-grids-to-the-jupyter-ecosystem\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":\"1\",\"name\":\"Home\",\"item\":\"https:\/\/www.bloomberg.com\/company\/\"},{\"@type\":\"ListItem\",\"position\":\"2\",\"name\":\"ipydatagrid adds interactive data grids to the Jupyter ecosystem\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.bloomberg.com\/company\/#website\",\"url\":\"https:\/\/www.bloomberg.com\/company\/\",\"name\":\"Bloomberg L.P.\",\"description\":\"Bloomberg L.P. is the leader in global business and financial information, enabling customers to make smarter, faster, more informed business decisions.\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.bloomberg.com\/company\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.bloomberg.com\/company\/#\/schema\/person\/4d4a18aae79d6fcc1ea98181a906905e\",\"name\":\"Bloomberg L.P.\",\"url\":\"https:\/\/www.bloomberg.com\/company\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"ipydatagrid adds interactive data grids to the Jupyter ecosystem | Bloomberg LP","description":"Itay Dafna, a developer of the open source ipydatagrid project, discusses the creation of this interactive data table widget for the Jupyter ecosystem.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.bloomberg.com\/company\/stories\/ipydatagrid-adds-interactive-data-grids-to-the-jupyter-ecosystem\/","og_locale":"en_US","og_type":"article","og_title":"ipydatagrid adds interactive data grids to the Jupyter ecosystem | Bloomberg LP","og_description":"Itay Dafna, a developer of the open source ipydatagrid project, discusses the creation of this interactive data table widget for the Jupyter ecosystem.","og_url":"https:\/\/www.bloomberg.com\/company\/stories\/ipydatagrid-adds-interactive-data-grids-to-the-jupyter-ecosystem\/","og_site_name":"Bloomberg L.P.","article_publisher":"https:\/\/www.facebook.com\/bloomberglp\/","article_published_time":"2021-12-08T15:23:17+00:00","article_modified_time":"2023-04-03T14:08:13+00:00","og_image":[{"width":1402,"height":598,"url":"https:\/\/assets.bbhub.io\/company\/sites\/51\/2021\/12\/image1.png","type":"image\/png"}],"author":"chaas30","twitter_card":"summary_large_image","twitter_image":"https:\/\/assets.bbhub.io\/company\/sites\/51\/2021\/12\/image1.png","twitter_creator":"@bloomberg","twitter_site":"@bloomberg","twitter_misc":{"Written by":"chaas30","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.bloomberg.com\/company\/stories\/ipydatagrid-adds-interactive-data-grids-to-the-jupyter-ecosystem\/","url":"https:\/\/www.bloomberg.com\/company\/stories\/ipydatagrid-adds-interactive-data-grids-to-the-jupyter-ecosystem\/","name":"ipydatagrid adds interactive data grids to the Jupyter ecosystem | Bloomberg LP","isPartOf":{"@id":"https:\/\/www.bloomberg.com\/company\/#website"},"datePublished":"2021-12-08T15:23:17+00:00","dateModified":"2023-04-03T14:08:13+00:00","author":{"@id":"https:\/\/www.bloomberg.com\/company\/#\/schema\/person\/4d4a18aae79d6fcc1ea98181a906905e"},"description":"Itay Dafna, a developer of the open source ipydatagrid project, discusses the creation of this interactive data table widget for the Jupyter ecosystem.","breadcrumb":{"@id":"https:\/\/www.bloomberg.com\/company\/stories\/ipydatagrid-adds-interactive-data-grids-to-the-jupyter-ecosystem\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.bloomberg.com\/company\/stories\/ipydatagrid-adds-interactive-data-grids-to-the-jupyter-ecosystem\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.bloomberg.com\/company\/stories\/ipydatagrid-adds-interactive-data-grids-to-the-jupyter-ecosystem\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":"1","name":"Home","item":"https:\/\/www.bloomberg.com\/company\/"},{"@type":"ListItem","position":"2","name":"ipydatagrid adds interactive data grids to the Jupyter ecosystem"}]},{"@type":"WebSite","@id":"https:\/\/www.bloomberg.com\/company\/#website","url":"https:\/\/www.bloomberg.com\/company\/","name":"Bloomberg L.P.","description":"Bloomberg L.P. is the leader in global business and financial information, enabling customers to make smarter, faster, more informed business decisions.","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.bloomberg.com\/company\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.bloomberg.com\/company\/#\/schema\/person\/4d4a18aae79d6fcc1ea98181a906905e","name":"Bloomberg L.P.","url":"https:\/\/www.bloomberg.com\/company"}]}},"featured_image_rendered":"<img srcset='https:\/\/assets.bbhub.io\/image\/v1\/resize?width=auto&type=webp&url=https:\/\/assets.bbhub.io\/company\/sites\/51\/2021\/12\/image1.png 1402w, https:\/\/assets.bbhub.io\/image\/v1\/resize?width=auto&type=webp&url=https:\/\/assets.bbhub.io\/company\/sites\/51\/2021\/12\/image1.png 300w, https:\/\/assets.bbhub.io\/image\/v1\/resize?width=auto&type=webp&url=https:\/\/assets.bbhub.io\/company\/sites\/51\/2021\/12\/image1.png 1024w, https:\/\/assets.bbhub.io\/image\/v1\/resize?width=auto&type=webp&url=https:\/\/assets.bbhub.io\/company\/sites\/51\/2021\/12\/image1.png 768w, https:\/\/assets.bbhub.io\/image\/v1\/resize?width=auto&type=webp&url=https:\/\/assets.bbhub.io\/company\/sites\/51\/2021\/12\/image1.png 170w, https:\/\/assets.bbhub.io\/image\/v1\/resize?width=auto&type=webp&url=https:\/\/assets.bbhub.io\/company\/sites\/51\/2021\/12\/image1.png 140w' src='https:\/\/assets.bbhub.io\/image\/v1\/resize?width=auto&type=webp&url=https:\/\/assets.bbhub.io\/company\/sites\/51\/2021\/12\/image1.png' alt='ipydatagrid implemented within BQuant' \/>","category_info":{"name":"Tech At Bloomberg","blog_landing_name":"Tech At Bloomberg"},"_links":{"self":[{"href":"https:\/\/www.bloomberg.com\/company\/wp-json\/wp\/v2\/posts\/20472","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.bloomberg.com\/company\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.bloomberg.com\/company\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.bloomberg.com\/company\/wp-json\/wp\/v2\/users\/184"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bloomberg.com\/company\/wp-json\/wp\/v2\/comments?post=20472"}],"version-history":[{"count":3,"href":"https:\/\/www.bloomberg.com\/company\/wp-json\/wp\/v2\/posts\/20472\/revisions"}],"predecessor-version":[{"id":30556,"href":"https:\/\/www.bloomberg.com\/company\/wp-json\/wp\/v2\/posts\/20472\/revisions\/30556"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.bloomberg.com\/company\/wp-json\/wp\/v2\/media\/18759"}],"wp:attachment":[{"href":"https:\/\/www.bloomberg.com\/company\/wp-json\/wp\/v2\/media?parent=20472"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.bloomberg.com\/company\/wp-json\/wp\/v2\/categories?post=20472"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bloomberg.com\/company\/wp-json\/wp\/v2\/tags?post=20472"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}