This page shows platform initiatives that have been completed on behalf of our member communities.
Run an experimental mybinder.org federation member on OVH7/7Completed 11d ago
As the leader of an organization that benefits from the broader scientific python ecosystem, I would like to find ways to contribute back on behalf of my institution. I know we benefit from capacity and smooth operations on mybinder.org, and I would like to put some money towards sustaining that. However, handling procurement and getting my institution to pay out a few hundred dollars consistently every month comes with very high overhead and not worth it. Since we have a contractual relationship with 2i2c, I would like to support mybinder.org through cloud spend through 2i2c.
As a volunteer member of the team running mybinder.org, I would like to run our infrastructure on a diverse set of cheap hosting providers. This gives us extra capacity but also resiliency, as a single provider kicking us out would not shut us down completely. Since we provide arbitrary code execution, we are prime targets for cryptominers and other forms of network abuse that hosting providers donβt like. Handling abuse reports from hosting providers is stressful, and if I knew that being kicked out (even temporarily) will not cause a full outage, Iβll be a lot less stressed.
Sub-issues
π£ Explicitly communicate the idea of 2i2c helping run a mybinder.org federation member to the mybinder.org communityUpdated 4mo ago
π£ Create a cloud account on OVH that we can share with othersUpdated 3mo ago
π£ Add OVH to our cloud billing processUpdated 1mo ago
π£ Add support for running on k3s+OVH to jupyterhub/mybinder.org-deployUpdated 3mo ago
π£ Move OVH billing to its own RAMP cardUpdated 2mo ago
π£ Deploy BIDS BinderHub on OVHUpdated 2mo ago
π£ Write a blog post about BIDS joining the mybinder.org federation through usUpdated 11d ago
Improve nbgitpuller error handling11/11Completed 11d ago
As a student, I am expected to click links that are provided to me (through my LMS, course website, slack or other medium) that will launch a jupyter notebook pre-populated with content related to my assignment or class. This mostly works fine, and preserves any changes I make in my content, and am happy! But in some rare cases, it does not work, and throws me a scary black error box with messages about git that I donβt really understand. Usually reaching out to my TAs can fix this, but it causes me stress and lost time.
As a TA, I often have to use the JupyterHub admin interface to run git commands to fix errors faced by some students when using nbgitpuller to distribute materials. I would very much rather spend my time on helping them learn, so more automatic ways to handle errors here would save me a lot of time.
Sub-issues
π£ Identify common nbgitpuller errorsUpdated 4mo ago
π£ Add access to a Jupyter frontend following an nbgitpuller errorUpdated 4mo ago
π£ Redesign nbgitpuller error handling response for link-consumersUpdated 4mo ago
π£ Design and integrate dedicated handler for merge errorsUpdated 2mo ago
π£ Design and integrate dedicated error handler for invalid linksUpdated 2mo ago
π£ Complete PR review processUpdated 2mo ago
π£ Make a beta releaseUpdated 2mo ago
π£ Write a blog post about the nbgitpuller error handling workUpdated 2mo ago
π£ Add beta release to a community hub image and monitorUpdated 28d ago
π£ Make a releaseUpdated 11d ago
π£ Announce on the Jupyter blogUpdated 11d ago
Refactor and improve the jupyterbook.org documentation to make it more accessible and easier to maintain0/0Completed 14d ago
As a Jupyter Book maintainer, I want to be able to update our community-facing documentation independently from our user-facing documentation. I want those updates to be immediately available to our community members without waiting for release cycles to update. I also want to know where to go to update different kinds of documentation.
As a Jupyter Book community member and user, I want an easy-to-remember place to refer to for important community documentation. For anything with a single source of truth (e.g., an events calendar), I donβt want to have multiple versions of the same page available because itβs tied to multiple βversionsβ of software in ReadTheDocs.
Rollout storage quotas to all AWS and GCP clusters5/5Completed 2mo ago
Sub-issues
π£ Rollout storage quotas to all AWS clusters/hubsUpdated 9mo ago
π£ [Rollout storage quotas to all GCP hubsUpdated 7mo ago
π£ Update team docs to match jupyterhub-home-nfs setupUpdated 2mo ago
π£ Fill in some gaps in the nfs quota migration docsUpdated 12mo ago
π£ Update the cluster/hub generation script to match current infrastructureUpdated 7mo ago
Provide group based cost rollups for hubs on AWS8/8Completed 4mo ago
Sub-issues
π£ Group costs: Update groups-exporter to handle one-to-many user <-> group relationshipsUpdated 6mo ago
π£ Group costs: Cost backend can understand user group membershipsUpdated 6mo ago
π£ Group costs: Cost logic for group rollupsUpdated 6mo ago
π£ Group costs: Create Group cloud costs Grafana dashboardUpdated 5mo ago
π£ Group costs: Rollout prototype to test hubsUpdated 5mo ago
π£ Group costs: Write tests and documentUpdated 5mo ago
π£ Group costs: Validate home storage metricsUpdated 5mo ago
π£ Group costs: Rollout and blog postUpdated 4mo ago
Per-user cost reporting with Grafana on AWS17/17Completed 6mo ago
Sub-issues
π£ Review SDD for #6315 [P&S Initiative] Per-user cost reporting with Grafana on AWSUpdated 9mo ago
π£ Establish collaboration on VEDA cost reporting with Tarashish (Development Seed)Updated 8mo ago
π£ Work with NASA VEDA admin to enable cost allocation tagsUpdated 7mo ago
π£ Cost monitoring backend can be installed as a standalone helm-chart repository (phase 1)Updated 8mo ago
π£ Cost monitoring backend can be installed as a standalone helm-chart repository (phase 2)Updated 8mo ago
π£ Home directory storage cost monitoring unavailable for EBS volumesUpdated 8mo ago
π£ Create a submodule to query usage metrics from PrometheusUpdated 8mo ago
π£ Obtain per-user compute usage with the cost monitoring backendUpdated 8mo ago
π£ Per-user costs can be calculated in the backendUpdated 8mo ago
π£ Write table test for pure functions to validate per user cost logicUpdated 8mo ago
π£ Deploy prototype on a test hubUpdated 7mo ago
π£ Design a Grafana dashboard panel to visualise per-user costsUpdated 7mo ago
π£ Write `jsonnet` to encapsulate Grafana dashboard design as codeUpdated 6mo ago
π£ Iterate given lessons learned from User cost monitoring prototypeUpdated 6mo ago
π£ Cost Monitoring MVP improvementsUpdated 6mo ago
π£ Rollout per-user cost reporting to productionUpdated 6mo ago
π£ Document new feature: cloud cost reporting and monitoringUpdated 6mo ago
Jupyter Book MVP for 2i2c communities15/15Completed 9mo ago
Sub-issues
π£ Add support for buttons in MySTUpdated 1y ago
π£ Allow programmatic identification of JupyterHub and BinderHubUpdated 1y ago
π£ Add "awesomebar"-like UX to MyST launch buttonUpdated 1y ago
π£ Plan the design for a MyST theme with a landing pageUpdated 1y ago
π£ Build book-theme variant with landing page supportUpdated 1y ago
π£ Follow up on landing pages PRs #5482 [myst]Updated 1y ago
π£ Follow up on awesomebar PR #5348 [myst]Updated 1y ago
π£ Update MyST launch button UI to inform users of constraintsUpdated 1y ago
π£ Refine "skeleton template repository" for #5045Updated 1y ago
π£ Engage with Project Pythia on improvements for MyST landing pagesUpdated 1y ago
π£ Deploy a basic template for community documentation with a landing page and knowledge baseUpdated 1y ago
π£ Update Service Guide documentation to reflect new community-site featureUpdated 11mo ago
π£ Update Infrastructure documentation to reflect new community-site deploymentUpdated 1y ago
π£ Review Infrastructure Guide PR for MyST MVPUpdated 11mo ago
π£ Improve layout of `justified` landing-page blocksUpdated 1y ago
Associate users with groups for usage monitoring13/13Completed 10mo ago
Sub-issues
π£ Refine #5315 and create subtasksUpdated 1y ago
π£ Use annotations instead of labels for usernames on podsUpdated 10mo ago
π£ Use `kube_pod_annotations` for usernames instead of `kube_pod_labels` in Grafana dashboardsUpdated 1y ago
π£ Make user and group information from JupyterHub available to PrometheusUpdated 10mo ago
π£ Enable jupyterhub-groups-exporter on test hubUpdated 11mo ago
π£ Users and user groups can be associated to existing usage metrics through PromQL and visualised in GrafanaUpdated 11mo ago
π£ Phased rollout of `manage_groups` feature for all GitHub authenticated hub deploymentsUpdated 11mo ago
π£ Rollout jupyterhub-groups-exporter for all hubs with `manage_groups` featureUpdated 10mo ago
π£ Populate and monitor JupyterHub group membershipsUpdated 10mo ago
π£ Add an alert for jupyterhub-groups-exporter pod dyingUpdated 10mo ago
π£ Set resource requests and limits appropriately for jupyterhub-groups-exporterUpdated 10mo ago
π£ Write a blog post to wrap up "Associate users with groups for usage monitoring" initiativeUpdated 10mo ago
π£ Hold retro on Platform Initiative #5315: Associate users with groups for usage monitoringUpdated 9mo ago
Support JupyterHub Deployments (with persistent home directories) on Jetstream27/7Completed 1y ago
Sub-issues
π£ Develop terraform config to create Jetstream2 disks and deploy jupyterhub-home-nfs to itUpdated 1y ago
π£ Ensure monitoring/alerting of disk space is enabled and working for Jetstream2 solutionUpdated 1y ago
π£ [Phase 3] Hub Setup - Jetstream2, project-pythia with jupyterhub-home-nfsUpdated 1y ago
π£ Document lack of disaster recovery on Jetstream2Updated 1y ago
π£ Investigate why autoscaling doesn't work for jetstream2 clusters created via our infrastructureUpdated 1y ago
π£ Update Product Menu SSOT with JetStream2Updated 1y ago
π£ Recreate the projectpythia cluster on JS2 that hosts a BinderHub instanceUpdated 1y ago
Deploy home directory quotas on GCP8/8Completed 1y ago
Sub-issues
π£ Develop terraform config to create GCP disks and deploy jupyterhub-home-nfs to itUpdated 1y ago
π£ Ensure monitoring/alerting of disk space is enabled and working for GCP solutionUpdated 1y ago
π£ Develop and enable automatic backups for a GCP disk running jupyterhub-home-nfsUpdated 1y ago
π£ Migrate LEAP staging hub onto jupyterhub-home-nfsUpdated 1y ago
π£ Migrate LEAP prod onto jupyterhub-home-nfsUpdated 1y ago
π£ Decommision LEAP's filestoreUpdated 1y ago
π£ Write a blog post announcing per user storage quotas on GCPUpdated 1y ago
π£ Update Product Menu and configurator form with GCP quotasUpdated 1y ago
VEDA Objective JH-1: Complete deployment of per-user home directories and dynamic image building to all hubs3/3Completed 1y ago
Sub-issues
π£ Migrate MAAP hub to use jupyterhub-home-nfsUpdated 1y ago
π£ Migrate GHG hub to use jupyterhub-home-nfsUpdated 1y ago
π£ Enable image building on ghg hubUpdated 1y ago
Deploy Binderhub on Jetstream2 for Project Pythia11/11Completed 1y ago
Sub-issues
π£ Deploy JupyterHub to JetStream2 using ClusterAPIUpdated 1y ago
π£ Manually create a cluster (no terraform)Updated 1y ago
π£ Manually deploy Binderhub on Jetstream2Updated 1y ago
π£ Refine phases - ProjectPythiaUpdated 1y ago
π£ Refine deploying BinderHub to Jetstream2 from our infrastructure repoUpdated 1y ago
π£ Deploy kubernetes cluster with terraform on Jetstream2Updated 8mo ago
π£ Provision a `kubeconfig` file that can work standaloneUpdated 1y ago
π£ Deploy our support charts on JetstreamUpdated 1y ago
π£ [Phase 3] Hub Setup - ProjectPythia BinderUpdated 1y ago
π£ Update hub deployment guide to document creating clusters on Jetstream2Updated 1y ago
π£ Write a blog post about supporting infrastructure on JetstreamUpdated 1y ago
Setup a system for automated GCP filestore backups3/3Completed 1y ago
Sub-issues
π£ Deploy filestore backups to all GCP clustersUpdated 1y ago
π£ Write a blog post announcing the gcp filestore backups projectUpdated 1y ago
π£ Add logging to this projectUpdated 1y ago
Implement per-user home directory quotas for AWS-hosted hubs11/11Completed 1y ago
Sub-issues
π£ [DevelopmentSeed partnership] Integrate jupyterhub-home-nfs helm chart into 2i2c infrastructureUpdated 1y ago
π£ [devseed] Set up automated backups using EBS snapshots for our home directory Volumes in AWSUpdated 1y ago
π£ [devseed] Set up alerting for an EBS volume getting close to full on AWS, and a runbook on how to resize it when neededUpdated 1y ago
π£ Deploy jupyterhub-home-nfs to nmfs-openscapesUpdated 1y ago
π£ Deploy jupyterhub-home-nfs to CryoCloudUpdated 1y ago
π£ Set resource requests and limits on jupyterhub-nfs-home nfs-server podUpdated 1y ago
π£ Debug and Verify that EBS disk size alerts go through to Slack channelUpdated 1y ago
π£ Enable alerting for all hubs we've rolled out jupyterhub-home-nfs toUpdated 1y ago
π£ Enable automatic homedirs backups for all hubs we've rolled out jupyterhub-home-nfs toUpdated 1y ago
π£ Write a blog post talking about the new home directory per-user quota functionalityUpdated 1y ago
π£ Social media campaign β Enforcing per-user storage quotas with `jupyterhub-home-nfs`Updated 1y ago