Analytics Status Report

Project Analytics from 2017-04-01 to 2017-07-01

Help

In Progress 159136 Piwik puppet configuration refactoring and updates In-Scope Cut 8.0
In Progress 143119 Pre-generate mysql ORM code for sqoop In-Scope Cut 13.0
In Progress 157977 upgrade druid and pivot In-Scope Cut 0.0
In Progress 135251 Investigate requests flagged as pageview in analytics header coming from bots In-Scope Cut None
In Progress 158331 Update undocumented EventLogging mediawiki hooks In-Scope Cut 2.0
In Progress 132256 Analytics hosts showed high temperature alarms In-Scope Cut None
In Progress 161619 Improve Oozie error emails for testing In-Scope Cut 1.0
In Progress 156384 Backend for wikistats 2.0 In-Scope Cut 0.0
In Progress 159727 Refactor monthly banner oozie job to use already indexed daily data In-Scope Cut None
In Progress 161933 Refactor aqs api and usage for simplicity In-Scope Cut 8.0
In Progress 159471 Add daily unique devices dataset to pivot In-Scope Cut 8.0
In Progress 160796 Change default timeline for browser reports to be recent (not 2015) In-Scope Cut 3.0
In Progress 118557 Replace Analytics XFF/client.ip data with X-Client-IP In-Scope Cut 5.0
In Progress 159219 Apply Xms Java Heap settings to all the Hadoop daemons In-Scope Cut None
In Progress 156841 Hadoop: Add a lower priority queue: nice queue In-Scope Cut 3.0
In Progress 161128 Update refinery sqoop script to explicitely fail in case a snapshot / destination folder already exists In-Scope Cut 3.0
In Progress 75331 Story: VitalSignsUser selects Monthly Pageviews metric In-Scope Cut 3.0
In Progress 152712 Replacement of stat1002 and stat1003 In-Scope Cut None
In Progress 117433 Spike: Investigate alternatives to Special:HideBanners cookie storm for cross-domain banner close-button In-Scope Cut 2.0
In Progress 161824 Add zero carrier to pageview_hourly data on druid In-Scope Cut 3.0
In Progress 161147 Provide cumulative edit count in Data Lake edit data In-Scope Cut 21.0
In Progress 161150 Use native timestamp types in Data Lake edit data In-Scope Cut 5.0
In Progress 161896 Add time_to_user_next_edit and time_to_page_next_edit in Mediawiki Denormalized History In-Scope Cut 13.0
In Progress 143927 Per Family Unique Devices Counts In-Scope Cut 0.0
In Progress 67508 Don't accept data from automated bots in Event Logging In-Scope Cut 8.0
In Progress 167952 analytics-privatedata-users access for ema Screep Done None
In Progress 70937 Turn on PHP on stat servers Screep Done None
In Progress 159839 EQIAD: stat1003 replacement In-Scope Done None
In Progress 112926 Beta Cluster EventLogging data is disappearing? Screep Done 0.0
In Progress 167199 Requesting access to the nda LDAP group for GoranSMilovanovic Screep Done None
In Progress 165678 clientIP needs to be collected as part of the schema or ... Screep Done None
In Progress 149993 sync bohrium and apt.wikimedia.org piwik versions In-Scope Done None
In Progress 168564 deployment-kafka01 / partition is full Screep Done None
In Progress 167797 analytics1067: Broken BBU Screep Done None
In Progress 159838 EQIAD: stat1002 replacement In-Scope Done None
In Progress 157943 Analytics cluster should connect to elasticsearch over SSL In-Scope Done None
In Progress 160886 Investigate recent Kafka Burrow alarms for EventLogging In-Scope Done None
In Progress 157091 Make EventBus service support wildcards in schema definitions In-Scope Done None
In Progress 157094 Create schema for Job event In-Scope Done None
In Progress 97562 WANObjectCache relay daemon or mcrouter support Screep Done None
In Progress 149228 Rename stat100x machines to have misc element names In-Scope Done None
In Progress 164178 Investigation: How can we improve the speed of the popular pages bot Screep Done 3.0
In Progress 118365 Increase request limits for GETs to /api/rest_v1/ Screep Done None
In Progress 169303 Archive analytics/kraken git repository Screep Done None
In Progress 166194 Database replication issues with deleted pages (affecting Tool Labs and Analytics Store) Screep Done None
In Progress 158310 Serbian Wikipedia edits spike 2016 In-Scope Done None
In Progress 86745 Eventlogging file logging code split weirdly between role and base class Screep Done None
In Progress 120841 Create fake data for beta AQS deployment In-Scope Done None
In Progress 90649 Provide performant query access to banner show/hide numbers In-Scope Done 4.0
In Progress 161597 Decom/Reclaim analytics1027 In-Scope Done 3.0
In Progress 94926 vanadium failed disk /dev/sda Screep Done None
In Progress 166405 Monitor if/when mediawiki history reconstruction partitions and imports fall out of sync Screep Done None
In Progress 96921 puppet agent disabled on beta cluster deployment-eventlogging02.eqiad.wmflabs instance Screep Done None
In Progress 167670 Expose revision-create in EventStreams Screep Done 2.0
In Progress 166391 Analytics access request Screep Done None
In Progress 112947 Nested EventLogging data doesn't get copied to MySQL Screep Done None
In Progress 95781 EL graphite data missing from 24/3 to 7/4 Screep Done None
In Progress 47718 Different Collations specified for the 'log' database vs the tables in them Screep Done None
In Progress 160942 Create mediawiki.page-restrictions-change event In-Scope Done None
In Progress 149178 Non existing article is one of the most viewed according to the data returned by the /metrics/pageviews/top/ API In-Scope Open 3.0
In Progress 166832 Import Kafka messages into HDFS authenticating with TLS/SSL Screep Open 13.0
In Progress 137321 Run ETL for wmf_raw.ActionApi into wmf.action_* aggregate tables In-Scope Open None
In Progress 153702 Update active editor metrics to use consensus definition In-Scope Open None
In Progress 159170 Find an alternative query interface for eventlogging on analytics cluster that can replace MariaDB In-Scope Open None
In Progress 166937 Broken /a/refinery-source/guard/run_all_guards.sh script on stat1002 Screep Open None
In Progress 145164 Add fields needed by ERI to mediawiki.revision-create In-Scope Open None
In Progress 166414 Explore NavigationTiming by faceted properties - EventLogging refine Screep Open None
In Progress 118310 Expose the results of the global metric at a public link, that's available immediately for the API {kudu} In-Scope Open 8.0
In Progress 144714 [REQUEST] Extract search queries from HTTP_REFERER field for a Wikibook In-Scope Open None
In Progress 165366 rack/setup/install replacement stat1006 (stat1003 replacement) Screep Open None
In Progress 157981 Serve global unique device counts externally In-Scope Open None
In Progress 165560 Artificial spike in offset of unique devices from November to February 6th on wikidata Screep Open None
In Progress 163933 Investigate oozie suspended workflows Screep Open None
In Progress 157978 Blog post about druid In-Scope Open 5.0
In Progress 164201 AQS unique devices api should report offset/underestimate separately Screep Open None
In Progress 139019 statistics about edit conflicts according to page type In-Scope Open None
In Progress 128374 Sort out analytics service dependency issues for cp* cache hosts In-Scope Open None
In Progress 131773 Making tests environment for pageview API deployments In-Scope Open None
In Progress 158972 productionize ClickStream dataset In-Scope Open None
In Progress 133407 fundraising-tech request: browser version breakdown by country In-Scope Open None
In Progress 148776 Screen cast for how to use Pivot (5 minutes) In-Scope Open 5.0
In Progress 167180 Emit revision-score event to EventBus and expose in EventStreams Screep Open None
In Progress 121136 Establish a process to periodically review and approve access for hadoop/hue users In-Scope Open None
In Progress 118841 Deploy pageview sanitization and start ongoing process {hawk} In-Scope Open 5.0
In Progress 131938 Evaluate whether to rewrite varnishkafka in python In-Scope Open None
In Progress 117945 Investigate anomalous views to pages with replacement characters In-Scope Open None
In Progress 76432 Validate JsonSchemaContent using MediaWIki core's handling In-Scope Open None
In Progress 162618 Measure portal pageviews Screep Open None
In Progress 147009 Create a Universal Layout for Dashiki for staging / testing config purposes In-Scope Open None
In Progress 159233 Create dashboard for upload wizard In-Scope Open None
In Progress 148461 Bot Identification: Inconsistent data in #all-sites-by-os-and-browser for IE7 In-Scope Open 3.0
In Progress 115119 Implement Schema:ExternalLinksChange In-Scope Open None
In Progress 147967 The WMF-Last-Access Set-Cookie header should follow RFC 2965 syntax rather than the pre-RFC Netscape format In-Scope Open None
In Progress 156844 Prep to decommission old dbstore hosts (db1046, db1047) In-Scope Open None
In Progress 145935 Responses on pageview API should be lighter In-Scope Open None
In Progress 118772 Use scap3 to deploy eventlogging/eventlogging In-Scope Open 21.0
In Progress 118842 Backfill pageview_hourly sanitization - 1 month - {hawk} - DUPLICATE THIS TASK FOR EACH MONTH TO BACKFILL In-Scope Open 8.0
In Progress 165634 Add li: Wikibooks to Wikistats Screep Open None
In Progress 155014 Import 2001 wikipedia data In-Scope Open None
In Progress 117221 [Epic] Update official Wikimedia press kit with accurate numbers In-Scope Open None
In Progress 102476 RFC: Requirements for change propagation In-Scope Open None
In Progress 144637 Check eventbus Kafka cluster settings for reliability In-Scope Open None
In Progress 158106 Update EventBus RCFeed config to use newly refactored settings In-Scope Open 0.0
In Progress 116206 Set up AQS in Beta In-Scope Open None
In Progress 144100 Pageview dumps incorrectly formatted, looks like a result of possibly malicious activity In-Scope Open None
In Progress 148469 Just an idea: poly-graph In-Scope Open None
In Progress 152522 Prevent notebooks on spark to launch 2 pyspark instances instead of 1 In-Scope Open None
In Progress 148843 GPU upgrade for stats machine In-Scope Open None
In Progress 117018 Fix the pageview API "top" spec and 404 reporting {slug} In-Scope Open None
In Progress 156656 Review parent task for any potential pageview definition improvements In-Scope Open None
In Progress 152731 Implement server side filtering (if we should) In-Scope Open 8.0
In Progress 168573 Dashiki Cleanup Screep Open None
In Progress 125829 Potentially decrease db1046's InnoDB buffer pool In-Scope Open None
In Progress 165736 Update Varnishkafka to support TLS encryption/authentication Screep Open None
In Progress 114162 Make sunburst and stacked-bars resize with window {crow} In-Scope Open 3.0
In Progress 163233 Implement Varnish-level rough ratelimiting Screep Open None
In Progress 58575 Browser and platform stats for logged-in vs. anon users for security and product support decisions In-Scope Open None
In Progress 142139 Top API user agents stats In-Scope Open None
In Progress 163380 Support posting Jobs to EventBus simultaneously with normal job processing Screep Open None
In Progress 89453 Hand off of Christian's MaxMind geolocation databases repository In-Scope Open None
In Progress 139487 Get 'sparklyr' working on stats1005 In-Scope Open None
In Progress 157092 Support per-topic configuration in EventBus service In-Scope Open None
In Progress 120037 Vital Signs: Please provide an "all languages" de-duplicated stream for the Community/Content groups of metrics In-Scope Open None
In Progress 105815 Pipeline for data-intensive applications from research to productization to integration In-Scope Open None
In Progress 127571 Percentage of users with DNT on In-Scope Open None
In Progress 125394 Ensure that EventBus extension gracefully handles service failures In-Scope Open None
In Progress 159079 JsonData and EventLogging have multiple classes with the same name In-Scope Open None
In Progress 163252 Add templating support to reportupdater scripts Screep Open None
In Progress 108757 Allow opting out from logging some of the default EventLogging fields on a schema-by-schema basis In-Scope Open None
In Progress 156523 Investigate adding user-friendly testing functionality to Reportupdater In-Scope Open None
In Progress 135812 20160431 produces "end timestamp is invalid, must be a valid date in YYYYMMDD format" In-Scope Open None
In Progress 155804 log-events topic emitted in EventBus In-Scope Open None
In Progress 161186 Pivot "MediaWiki history" data lake: Feature request for "Time" dimension to sp\lit by calendar month / quarter / year -- needs druid 0.10 In-Scope Open None
In Progress 163725 Enable nested on-wiki config pages in mediawiki-storage Screep Open None
In Progress 131280 Making geowiki data public In-Scope Open None
In Progress 159962 Spike: Spark 2.x as cluster default (working with oozie) In-Scope Open None
In Progress 120852 Send burrow lag statistics to statsd/graphite {hawk} In-Scope Open None
In Progress 163789 Investigate whether we could calculate "hourly unique devices" Screep Open None
In Progress 144837 Investigate lowering "per-article" resolution data in AQS In-Scope Open None
In Progress 131782 Put data needed for edits metrics through Event Bus into HDFS In-Scope Open None
In Progress 132691 Clean up property passing in dashiki In-Scope Open None
In Progress 161185 Pivot "MediaWiki history" data lake: Feature request for "Event Users" In-Scope Open None
In Progress 168927 Smartctl errors for one kafka1012 disk Screep Open 3.0
In Progress 125015 Requests to (hard) redirect pages return their target's contents but are counted as pageviews to the redirect page In-Scope Open None
In Progress 142408 Better publishing of Annotations about Data Issues In-Scope Open None
In Progress 157705 Kafka mirror maker failures when kafka brokers are restarted In-Scope Open None
In Progress 124319 Add json linting test for schemas in mediawiki/event-schemas In-Scope Open None
In Progress 156657 dashiki should execute tests on jenkins In-Scope Open None
In Progress 161027 Puppetize event schema topic configuration In-Scope Open None
In Progress 122245 REST API entry point web request statistics at the Varnish level In-Scope Open None
In Progress 114469 Investigate US traffic by state normalized by population In-Scope Open None
In Progress 115634 --- Items above are triaged ----------------------- In-Scope Open None
In Progress 158334 Make Spark 2.1 easily available on new CDH5.10 cluster In-Scope Open None
In Progress 166712 Remove logging from labs for schema https://meta.wikimedia.org/wiki/Schema:CommandInvocation Screep Open None
In Progress 126290 Improve joining mechanism between webrequest data and edit data for i.e. sampling pageviews In-Scope Open None
In Progress 145828 passport-mediawiki-oauth doesn't support callback parameter In-Scope Open None
In Progress 160630 Please update Tulu Language(tcy)in Wikipedia Statistics. In-Scope Open None
In Progress 88775 Add mediacounts to pageview API In-Scope Open None
In Progress 163908 Monitor more HDFS health metrics Screep Open 3.0
In Progress 115042 Make banner impression counts available somewhere public Screep Open None
In Progress 164801 Research and define initial technical requirements for app analytics Screep Open None
In Progress 166248 Upgrade Analytics Cluster to Java 8 Screep Open None
In Progress 165233 Data Lake edit data missing for many wikis Screep Open None
In Progress 125345 Many error 500 from pageviews API "Error in Cassandra table storage backend" In-Scope Open None
In Progress 132405 Collect information about how we collect user statistics in one place In-Scope Open None
In Progress 163177 can't compile numpy on stat1004 Screep Open None
In Progress 164008 Update druid to latest release Screep Open 13.0
In Progress 147196 EventLogging sees MobileWikiAppFindInPage parsing errors In-Scope Open None
In Progress 156965 Remove user_agent_map from pageview_hourly long term In-Scope Open None
In Progress 135762 A/B Testing solid framework In-Scope Open None
In Progress 116188 Add help page in wikitech on what the analytics team can do for you similar to release engineering page In-Scope Open None
In Progress 164596 Provide uniques offset/underestimate breakdowns in AQS Screep Open None
In Progress 166689 Provide top domain and data to truly test superset Screep Open 8.0
In Progress 120330 Bot to call global metrics to event page {kudu} In-Scope Open None
In Progress 134231 Wikipedia Clickstream dataset. Programmatic Access In-Scope Open None
In Progress 166877 Bring the Editor Engagement Dashboard back Screep Open None
In Progress 150106 Type collisions in log events causing indexing failures in ELK Elasticsearch Screep Open None
In Progress 92502 Dashboard Directory Design Feedback In-Scope Open None
In Progress 131889 geowiki data for Global Innovation Index In-Scope Open None
In Progress 136125 Dashiki, Unique Devices and Pageview data breakdown doesn't work if any of the items are not available for the project In-Scope Open None
In Progress 167907 Incorporate data from the GeoIP2 ISP database to webrequest Screep Open None
In Progress 159269 Clean up remaining Dashiki configs on meta In-Scope Open None
In Progress 157088 [EPIC] Develop a JobQueue backend based on EventBus In-Scope Open None
In Progress 157697 Add error component to Dashiki In-Scope Open None
In Progress 126281 [Regression] stats.wikipedia.org redirect no longer works ("Domain not served here") In-Scope Open None
In Progress 159337 Automate refinery jar cleanup In-Scope Open None
In Progress 110459 Allow clicking on links in annotations In-Scope Open None
In Progress 116678 Country mapping routine for proxied requests In-Scope Open None
In Progress 136732 Puppetize job that saves old versions of geoIP database In-Scope Open None
In Progress 159046 Track page views by page ID rather than title (handles moved pages) In-Scope Open None
In Progress 44360 Provide regular cross-wiki reports on flagged revisions status Screep Open None
In Progress 112846 Display automata and humans separately on zero results rate graph In-Scope Open None
In Progress 168538 Perf test RAID vs JBOD with new hardware and kafka versions Screep Open 5.0
In Progress 126494 Look into encrypting logs sent between mediawiki app servers and kafka In-Scope Open None
In Progress 150483 Set up a fake Pageview API endpoint for the beta cluster In-Scope Open None
In Progress 160822 Filter local IPs before checking for geo info In-Scope Open None
In Progress 93217 Troubleshoot Wikimetrics RAE reports In-Scope Open None
In Progress 164280 Host API for token persistence dataset Screep Open None
In Progress 161149 Provide edit tags in the Data Lake edit data In-Scope Open None
In Progress 90240 Could it be that the geo IP matching is not accurate for Africa? In-Scope Open None
In Progress 142395 Improve initial load performance for dashiki dashboards In-Scope Open None
In Progress 137454 Bot from an Azure cloud cluster is causing a false pageview spike (can we identify as bot?) In-Scope Open 8.0
In Progress 111611 Accented letters seem to be rejected in cohort names In-Scope Open None
In Progress 136126 Better menu for metrics In-Scope Open None
In Progress 163134 Reportupdater writes a README in the output folder Screep Open None
In Progress 167290 Sqoop wbc_entity_usage from all wikis into hadoop (HDFS) Screep Open None
In Progress 167608 Add caused_by_user_text to mediawiki_page_history Screep Open None
In Progress 167427 Configure superset to query mysql slaves Screep Open 5.0
In Progress 167039 Upgrade Kafka on main cluster with security features Screep Open None
In Progress 133575 Provide weekly top pageviews stats In-Scope Open None
In Progress 106034 Too few page views for June/July 2015 In-Scope Open None
In Progress 114199 Upgrade eventlogging servers to Jessie In-Scope Open None
In Progress 159584 Secure hue and other private data access sites with 2FA In-Scope Open None
In Progress 121561 Encrypt Kafka traffic, and restrict access via ACLs In-Scope Open 0.0
In Progress 162933 Endpoint for average view rate in Pageview API Screep Open None
In Progress 127995 Create table in hive with a continent lookup for countries In-Scope Open None
In Progress 163229 Review by legal department of text on wikistats site Screep Open 1.0
In Progress 6537 Categories created using Tamil words not recognised in stats In-Scope Open None
In Progress 141506 Suddenly outrageous higher pageviews for main pages In-Scope Open None
In Progress 76914 User reads result of validation after creating a cohort In-Scope Open None
In Progress 102079 Metrics about the use of the Wikimedia web APIs In-Scope Open None
In Progress 164500 Add jobs for druid compaction for pageviews data set Screep Open None
In Progress 108414 Load API request count and latency data from Hadoop to a dashboard In-Scope Open None
In Progress 146911 Quantify false positives when filtering for number of distinct user agents per page in top pages computation In-Scope Open None
In Progress 127850 Improve Hue user management In-Scope Open None
In Progress 143819 Data request for logs from SparQL interface at query.wikidata.org Screep Open None
In Progress 119897 Create cron on 1002 to remove CirrusSearchRequest partitions In-Scope Open None
In Progress 143689 Bookmarkable date filters for browser stats dashboard In-Scope Open None
In Progress 152788 Pull data for edit reconstruction from labs In-Scope Open None
In Progress 159840 Alarm on data quality issues In-Scope Open None
In Progress 166339 Are watchlists dead? Screep Open None
In Progress 95456 "Create Report" button does not appear when uploading a new cohort In-Scope Open None
In Progress 130832 cdh::hadoop::directory (and other hdfs puppet command?) should quickly check if namenode is active before executing In-Scope Open None
In Progress 161635 Storage for banner history data In-Scope Open None
In Progress 110903 Make webperf eventlogging consumers use eventlogging on Kafka In-Scope Open None
In Progress 150369 Record an event every time a new content namespace page is created Screep Open 5.0
In Progress 107250 Remove links in wikistats to minnan.wikipedia.org Screep Open None
In Progress 116387 Refactor webrequest_source partitions and oozie jobs In-Scope Open None
In Progress 120036 Vital Signs: Please make the data for enwiki and other big wikis less sad, and not just be missing for most days In-Scope Open None
In Progress 117236 Track overall traffic, without any filtering, broken down into major categories, for internal use. In-Scope Open None
In Progress 161146 Provide historical redirect flag in Data Lake edit data In-Scope Open None
In Progress 167790 Refactor puppet code for the Hadoop Analytics cluster to roles/profiles Screep Open None
In Progress 144299 Dashboards working on mobile In-Scope Open None
In Progress 120249 Define what constitutes a search pageview In-Scope Open None
In Progress 153029 EventBus logs don't show up in logstash In-Scope Open None
In Progress 131158 Describe threat model for sanitized pageview data {mole} In-Scope Open 13.0
In Progress 134524 Pageview API: Limit (and document) size of data you can request In-Scope Open None
In Progress 119094 Expose pageview data in each project's REST API In-Scope Open None
In Progress 123958 Consider scrapping Schema:PageContentSaveComplete and Schema:NewEditorEdit, given we have Schema:Edit In-Scope Open None
In Progress 168648 Productionize analysis of editcount vs per_user_revision_count Screep Open None
In Progress 151211 kafka alarms audit In-Scope Open None
In Progress 152546 de-duplicate archive records matching revision records in mediawiki_history In-Scope Open None
In Progress 154912 Is User-Agent data PII when associated with Action API requests? In-Scope Open None
In Progress 113695 Clean the code review queue of analytics/wikistats In-Scope Open None
In Progress 114884 Some special characters break Wikimetrics' encoding {dove} In-Scope Open None
In Progress 136858 Beeline does not print full stack traces when a query fails {hawk} In-Scope Open None
In Progress 150713 Provide filterable line graph for browser-family/browser-major In-Scope Open None
In Progress 71145 Story: AnalyticsEng has editor_day table in labsdb In-Scope Open None
In Progress 158166 Discuss labsdb visibility of rev_text_id and ar_comment In-Scope Open None
In Progress 149594 Delete stale topics from main Kafka clusters In-Scope Open None
In Progress 145197 WMF pageview API (404 error) when requesting statitsics over around 1000 files on GLAMorgan In-Scope Open None
In Progress 162770 SATA errors for stat1004 in the dmesg Screep Open None
In Progress 119996 Have dashiki read and write GET params to pass stateful versions of dashboard pages {crow} In-Scope Open None
In Progress 166833 Produce webrequests from varnishkafka to Kafka with Kafka message timestamp set to configurable content field Screep Open None
In Progress 136127 Breakdowns should be bookmarkeable In-Scope Open None
In Progress 118402 Make AQS return 0 instead of no values {slug} In-Scope Open None
In Progress 118839 Productionize Pageview_sanitization hive code with Oozie job and refinery inclusion {hawk} In-Scope Open 8.0
In Progress 89397 Investigate getting redirect_page_id as an x_analytics field using the X analytics extension. {pika} In-Scope Open None
In Progress 150439 Tests for swagger spec stream routes in EventStreams In-Scope Open 5.0
In Progress 116658 Add Application errors for Mediawiki API to x-analytics In-Scope Open None
In Progress 168550 Productionize Tranquility (or shut it off) Screep Open None
In Progress 138505 Split opera mini in proxy or turbo mode In-Scope Open None
In Progress 121912 Better redirect handling for pageview API In-Scope Open None
In Progress 121286 Central repository of global metrics reports {kudu} In-Scope Open None
In Progress 160311 Sort inconsistency in AQS timestamp behavior In-Scope Open None
In Progress 146774 Add external link to tabs layout In-Scope Open None
In Progress 126501 Load Avro schemas from configurable external path In-Scope Open 13.0
In Progress 158896 Provide a spark job processing history and text to extract citations diffs In-Scope Open None
In Progress 166331 Pivot - Article Page Views Screep Open None
In Progress 155507 Meta-statistics on MediaWiki history reconstruction process In-Scope Open None
In Progress 165309 Create small sample mediawiki-history table in MariaDB Screep Open None
In Progress 165368 rack/setup/install replacement to stat1005 (stat1002 replacement) Screep Open None
In Progress 126279 Add pivot parameter to tabular layout graphs {lama} In-Scope Open None
In Progress 167304 Understand Kafka ACLs and figure out what ACLs we want for production topics Screep Open 8.0
In Progress 164259 Add VSL error counters to Varnishkafka stats Screep Open None
In Progress 112284 Create new table for 'referer' aggregated data In-Scope Open None
In Progress 152222 Make aggregated MediaWiki Pingback data publicly available In-Scope Open None
In Progress 89726 Analyze difference in Edit Schema "bounce rates" across wikis {lion} In-Scope Open None
In Progress 146130 Inconsistent Cassandra disk load shown in metrics and nodetool status In-Scope Open None
In Progress 126218 Replicate wikitech wikis to analytics-store.eqiad.wmnet In-Scope Open None
In Progress 166249 Bulk/Batch event endpoint Screep Open None
In Progress 120713 delete useless wikimetrics.report or cohort records In-Scope Open None
In Progress 112009 Re-baselining checkpoints periodically In-Scope Open None
In Progress 124082 As an end-user I shouldn't see non-articles in the list of top articles In-Scope Open None
In Progress 142073 Improve user management for AQS In-Scope Open 5.0
In Progress 156037 Load cirrussearch data into druid In-Scope Open None
In Progress 138396 Create ops dashboard with info like ipv6 traffic split In-Scope Open None
In Progress 164377 [Spike] Store article quality data inside hadoop and make AQS outputs a public API Screep Open None
In Progress 108850 Set up auto-purging after 90 days {tick} In-Scope Open None
In Progress 141117 Report on Wikimedia's industry ranking In-Scope Open None
In Progress 121262 Display global metrics report results on same page as report inputs {kudu} In-Scope Open None
In Progress 148656 Edit analysis dashboard Failures by User Type chart does not update correctly In-Scope Open None
In Progress 141010 Adding top counts for wiki projects (ex: WikiProject:Medicine) to pageview API In-Scope Open 21.0
In Progress 159264 Prototype counting of requests with real time (streaming data) In-Scope Open None
In Progress 161731 Create reliable change stream for specific wiki In-Scope Open None
In Progress 138426 Spike: Evaluate alternatives to varnishkafka: varnishevents In-Scope Open None
In Progress 90759 Create Daily & Monthly pageview dump with country data In-Scope Open None
In Progress 164593 Provide unqiues estimate/offset breakdowns in AQS Screep Open None
In Progress 113817 Connect Hadoop records of the same request coming via different channels In-Scope Open None
In Progress 163379 Create JobQueue implementation that posts to EventBus Screep Open None
In Progress 166679 Reinstate a subset of reports removed from the reportcard until WikiStats 2.0 is back Screep Open None
In Progress 150343 Puppetize clickhouse In-Scope Open 8.0
In Progress 117290 Create a tool that can read the elements of a wiki template and call the API {kudu} In-Scope Open None
In Progress 160679 Test pushing EventLogging through the ELK stack In-Scope Open None
In Progress 98831 Honor DNT header for access logs & varnish logs In-Scope Open None
In Progress 131127 Browser Reports. Break down "Other" bucket a little more? In-Scope Open None
In Progress 163909 Monitor that no worker nodes are in the default rack in net topology Screep Open 3.0
In Progress 87604 Add ops-reportcard dashboard with analysis that shows the http to https slowdown on russian wikipedia In-Scope Open None
In Progress 161935 Vagrant git-update error for event logging Screep Open None
In Progress 103726 Report page views for labs instances In-Scope Open None
In Progress 166341 SSDs for main Kafka clusters Screep Open None
In Progress 155497 Measure Community Backlog. In-Scope Open 0.0
In Progress 164348 Investigate the use of local_quorum for AQS Screep Open 5.0
In Progress 167992 rack/setup/install new kafka nodes kafka-jumbo100[1-6] Screep Open None
In Progress 135174 Move contents of ee-dashboards to edit-analysis.wmflabs.org In-Scope Open None
In Progress 116578 Fix layout of the daily email that sends pageview dataset status In-Scope Open None
In Progress 168554 Default hive table creation to parquet - needs hive 2.3.0 Screep Open None
In Progress 128623 Purge all Schema:Echo data after 90 days In-Scope Open None
In Progress 76782 security review of Wikimetrics {dove} In-Scope Open None
In Progress 163113 Adding breakdowns to mw edit history reconstruction: wiki projects, categories (cohort) Screep Open None
In Progress 61832 Remove ad-hoc UA logging from existing schemas In-Scope Open None
In Progress 138207 [Open question] Improve bot identification at scale In-Scope Open None
In Progress 143743 Set up the foundation for the ReviewStream feed Screep Open None
In Progress 148053 Switch to fetch away from jquery In-Scope Open 13.0
In Progress 117480 Provide machine readable directory indexes on http://datasets.wikimedia.org/aggregate-datasets/ In-Scope Open None
In Progress 142535 Find out what happens to the old rows in the revision table In-Scope Open None
In Progress 144639 Propose metrics along with qualifiers for the press kit In-Scope Open None
In Progress 162308 Eventlogging client needs to support offline events Screep Open None
In Progress 169245 Document revision-create event for EventStreams Screep Open 1.0
In Progress 92875 Add page_id and namespace to X-Analytics header in App / api requests In-Scope Open None
In Progress 149736 Bikeshed what events should be exposed in public EventStreams API In-Scope Open 0.0
In Progress 113234 Update passport-mediawiki module URLs and documentation In-Scope Open None
In Progress 152257 Report updater should support Graphite mapping plugins In-Scope Open None
In Progress 151904 User limits for stat machines. Limit space on /home dir and possibly /tmp In-Scope Open None
In Progress 150028 RFC: Requirements for analytics stats processor In-Scope Open None
In Progress 163797 add a more friendly message to ladp authentication box for pivot Screep Open None
In Progress 71462 Wikimetrics is not supporting mlwiki cohort In-Scope Open None
In Progress 119772 Create dashboard showing MediaWiki tarball download statistics Screep Open None
In Progress 155478 Copy cached API requests from raw webrequests table to ApiAction In-Scope Open None
In Progress 136025 Simplify readiness checking by making a ready computed In-Scope Open None