Analytics Status Report

Project Analytics from 2017-07-01 to 2017-08-21

Help

In Progress 159233 Create dashboard for upload wizard In-Scope Cut None
In Progress 155497 Measure Community Backlog. In-Scope Cut 0.0
In Progress 121561 Encrypt Kafka traffic, and restrict access via ACLs In-Scope Cut 0.0
In Progress 168538 Perf test RAID vs JBOD with new hardware and kafka versions In-Scope Cut 5.0
In Progress 149178 Non existing article is one of the most viewed according to the data returned by the /metrics/pageviews/top/ API In-Scope Cut 3.0
In Progress 119094 Expose pageview data in each project's REST API In-Scope Cut None
In Progress 165368 rack/setup/install replacement to stat1005 (stat1002 replacement) In-Scope Cut None
In Progress 165736 Update Varnishkafka to support TLS encryption/authentication In-Scope Cut None
In Progress 167304 Understand Kafka ACLs and figure out what ACLs we want for production topics In-Scope Cut 8.0
In Progress 168927 Smartctl errors for one kafka1012 disk In-Scope Cut 3.0
In Progress 163909 Monitor that no worker nodes are in the default rack in net topology In-Scope Cut 3.0
In Progress 165366 rack/setup/install replacement stat1006 (stat1003 replacement) In-Scope Cut None
In Progress 163229 Review by legal department of text on wikistats site In-Scope Cut 1.0
In Progress 163908 Monitor more HDFS health metrics In-Scope Cut 3.0
In Progress 169245 Document revision-create event for EventStreams In-Scope Cut 1.0
In Progress 153029 EventBus logs don't show up in logstash In-Scope Cut None
In Progress 167790 Refactor puppet code for the Hadoop Analytics cluster to roles/profiles In-Scope Cut None
In Progress 170664 Migrate WMDE campaign and WDCM analytics from stat1002, 1003 to stat1005, 1006 Elaborated Done None
In Progress 163379 Create JobQueue implementation that posts to EventBus In-Scope Done None
In Progress 170864 Delete eventlogging alerts e-mail list Screep Done None
In Progress 131773 Making tests environment for pageview API deployments In-Scope Done None
In Progress 171790 chooseCRANmirror() and install.packages problems in R on production Screep Done None
In Progress 160644 Eventstreams graphite disk usage In-Scope Done None
In Progress 152788 Pull data for edit reconstruction from labs In-Scope Done None
In Progress 69823 Max recursion limit hit Screep Done None
In Progress 169513 wikipedia.org doesn't work, www.wikipedia.org does Screep Done None
In Progress 170066 MySQL password for research@analytics-store.eqiad.wmnet publicly revealed Screep Done None
In Progress 169270 Site for Wikimedia Analytics lacks clear license Screep Done None
In Progress 164801 Research and define initial technical requirements for app analytics In-Scope Done None
In Progress 169560 Create tag "Analytics-Data-Quality" on Phabricator Screep Done None
In Progress 170452 Code Review Needed: WMDE Summer Banner Campaign Analytics - stat1002 Screep Done None
In Progress 162770 SATA errors for stat1004 in the dmesg In-Scope Done None
In Progress 166247 Remove EventLogging for cookie blocks Screep Done 1.0
In Progress 171187 Public folder on stat1005 for Discovery's A/B test reports Screep Done None
In Progress 170792 Please Check Pivot Data on Campaign Banners Screep Done None
In Progress 172379 Why top views data of different sources is not the same? Screep Done None
In Progress 150369 Record an event every time a new content namespace page is created In-Scope Done 5.0
In Progress 116206 Set up AQS in Beta In-Scope Done None
In Progress 169898 Managing size of page-create and revision-create tables in storage. Aggregation? Elaborated Done 8.0
In Progress 170400 Define metrics for search result quality for the entity selector widget on wikidata. Screep Done None
In Progress 157705 Kafka mirror maker failures when kafka brokers are restarted In-Scope Done None
In Progress 120409 RESTBase should honor wiki-wide deletion/suppression of users Screep Done None
In Progress 131889 geowiki data for Global Innovation Index In-Scope Done None
In Progress 120212 Security review of EventBus extension Screep Done None
In Progress 170018 Duplicate events sent in Firefox after back button press Screep Done 5.0
In Progress 172296 Determine how to gather top-viewed article lists for use in generating ZIM files Screep Done None
In Progress 162308 Eventlogging client needs to support offline events In-Scope Open None
In Progress 152257 Report updater should support Graphite mapping plugins In-Scope Open None
In Progress 172335 WiViVi: Per-person should account for connected percentage? Screep Open None
In Progress 131782 Put data needed for edits metrics through Event Bus into HDFS In-Scope Open None
In Progress 119772 Create dashboard showing MediaWiki tarball download statistics In-Scope Open None
In Progress 155478 Copy cached API requests from raw webrequests table to ApiAction In-Scope Open None
In Progress 136025 Simplify readiness checking by making a ready computed In-Scope Open None
In Progress 148461 Bot Identification: Inconsistent data in #all-sites-by-os-and-browser for IE7 In-Scope Open 3.0
In Progress 171048 Eventbus does not handle gracefully changes in DNS recursors Screep Open None
In Progress 153702 Update active editor metrics to use consensus definition In-Scope Open None
In Progress 89887 Clean up permissions for privatedata files on stat1002 - they should be group readable by statistics-privatedata-users Screep Open None
In Progress 159170 Find an alternative query interface for eventlogging on analytics cluster that can replace MariaDB In-Scope Open None
In Progress 154912 Is User-Agent data PII when associated with Action API requests? In-Scope Open None
In Progress 145164 Add fields needed by ERI to mediawiki.revision-create In-Scope Open None
In Progress 166414 Explore NavigationTiming by faceted properties - EventLogging refine In-Scope Open None
In Progress 144714 [REQUEST] Extract search queries from HTTP_REFERER field for a Wikibook In-Scope Open None
In Progress 163933 Investigate oozie suspended workflows In-Scope Open None
In Progress 157978 Blog post about druid In-Scope Open 5.0
In Progress 164201 AQS unique devices api should report offset/underestimate separately In-Scope Open None
In Progress 173006 EventStreams (via KafkaSSE) does not consume from newly added partitions in topic Screep Open 8.0
In Progress 139019 statistics about edit conflicts according to page type In-Scope Open None
In Progress 128374 Sort out analytics service dependency issues for cp* cache hosts In-Scope Open None
In Progress 158972 productionize ClickStream dataset In-Scope Open None
In Progress 133407 fundraising-tech request: browser version breakdown by country In-Scope Open None
In Progress 148776 Screen cast for how to use Pivot (5 minutes) In-Scope Open 5.0
In Progress 168414 Purge all old data from EventLogging master In-Scope Open None
In Progress 121136 Establish a process to periodically review and approve access for hadoop/hue users In-Scope Open None
In Progress 102476 RFC: Requirements for change propagation In-Scope Open None
In Progress 117945 Investigate anomalous views to pages with replacement characters In-Scope Open None
In Progress 152731 Implement server side filtering (if we should) In-Scope Open 8.0
In Progress 76432 Validate JsonSchemaContent using MediaWIki core's handling In-Scope Open None
In Progress 163233 Implement Varnish-level rough ratelimiting In-Scope Open None
In Progress 157977 upgrade druid and pivot In-Scope Open 0.0
In Progress 147009 Create a Universal Layout for Dashiki for staging / testing config purposes In-Scope Open None
In Progress 145935 Responses on pageview API should be lighter In-Scope Open None
In Progress 158106 Update EventBus RCFeed config to use newly refactored settings In-Scope Open 0.0
In Progress 166341 SSDs for main Kafka clusters In-Scope Open None
In Progress 173585 Troubleshoot Wikimetrics "magic button" Screep Open None
In Progress 116658 Add Application errors for Mediawiki API to x-analytics In-Scope Open None
In Progress 150106 Type collisions in log events causing indexing failures in ELK Elasticsearch In-Scope Open None
In Progress 135174 Move contents of ee-dashboards to edit-analysis.wmflabs.org In-Scope Open None
In Progress 165634 Add li: Wikibooks to Wikistats In-Scope Open None
In Progress 155014 Import 2001 wikipedia data In-Scope Open None
In Progress 115119 Implement Schema:ExternalLinksChange In-Scope Open None
In Progress 117221 [Epic] Update official Wikimedia press kit with accurate numbers In-Scope Open None
In Progress 170162 hdfs password file for mysql should be re-generated when the password file is changed by puppet Screep Open None
In Progress 144637 Check eventbus Kafka cluster settings for reliability In-Scope Open None
In Progress 144299 Dashboards working on mobile In-Scope Open None
In Progress 144100 Pageview dumps incorrectly formatted, looks like a result of possibly malicious activity In-Scope Open None
In Progress 166832 Import Kafka messages into HDFS authenticating with TLS/SSL In-Scope Open 13.0
In Progress 108414 Load API request count and latency data from Hadoop to a dashboard In-Scope Open None
In Progress 170429 Deploy Wikistats and analytics.wikimedia.org via SCAP Screep Open None
In Progress 148469 Just an idea: poly-graph In-Scope Open None
In Progress 152522 Prevent notebooks on spark to launch 2 pyspark instances instead of 1 In-Scope Open None
In Progress 148843 GPU upgrade for stats machine In-Scope Open None
In Progress 117018 Fix the pageview API "top" spec and 404 reporting {slug} In-Scope Open None
In Progress 118841 Deploy pageview sanitization and start ongoing process {hawk} In-Scope Open 5.0
In Progress 168573 Dashiki Cleanup In-Scope Open None
In Progress 125829 Potentially decrease db1046's InnoDB buffer pool In-Scope Open None
In Progress 114162 Make sunburst and stacked-bars resize with window {crow} In-Scope Open 3.0
In Progress 58575 Browser and platform stats for logged-in vs. anon users for security and product support decisions In-Scope Open None
In Progress 123958 Consider scrapping Schema:PageContentSaveComplete and Schema:NewEditorEdit, given we have Schema:Edit In-Scope Open None
In Progress 136084 Unexpected increase in traffic for 4 languages in same region, on smaller projects Elaborated Open None
In Progress 173244 [Investigate] Use PMML for prediction model serialization Screep Open None
In Progress 139487 Get 'sparklyr' working on stats1005 In-Scope Open None
In Progress 170157 decommission rcs100[12] Elaborated Open 3.0
In Progress 120037 Vital Signs: Please provide an "all languages" de-duplicated stream for the Community/Content groups of metrics In-Scope Open None
In Progress 156656 Review parent task for any potential pageview definition improvements In-Scope Open None
In Progress 160822 Filter local IPs before checking for geo info In-Scope Open None
In Progress 105815 Pipeline for data-intensive applications from research to productization to integration In-Scope Open None
In Progress 127571 Percentage of users with DNT on In-Scope Open None
In Progress 125394 Ensure that EventBus extension gracefully handles service failures In-Scope Open None
In Progress 118842 Backfill pageview_hourly sanitization - 1 month - {hawk} - DUPLICATE THIS TASK FOR EACH MONTH TO BACKFILL In-Scope Open 8.0
In Progress 163252 Add templating support to reportupdater scripts In-Scope Open None
In Progress 159962 Spike: Spark 2.x as cluster default (working with oozie) In-Scope Open None
In Progress 156523 Investigate adding user-friendly testing functionality to Reportupdater In-Scope Open None
In Progress 135812 20160431 produces "end timestamp is invalid, must be a valid date in YYYYMMDD format" In-Scope Open None
In Progress 155804 log-events topic emitted in EventBus In-Scope Open None
In Progress 161186 Pivot "MediaWiki history" data lake: Feature request for "Time" dimension to sp\lit by calendar month / quarter / year -- needs druid 0.10 In-Scope Open None
In Progress 163725 Enable nested on-wiki config pages in mediawiki-storage In-Scope Open None
In Progress 131280 Making geowiki data public In-Scope Open None
In Progress 157981 Serve global unique device counts externally In-Scope Open None
In Progress 120852 Send burrow lag statistics to statsd/graphite {hawk} In-Scope Open None
In Progress 163789 Investigate whether we could calculate "hourly unique devices" In-Scope Open None
In Progress 170620 Alarm on errors on /var/log/upstart/eventlogging* files Screep Open None
In Progress 171629 Stop collecting Data for PageCreation schema, archive table on hdfs Screep Open 8.0
In Progress 144837 Investigate lowering "per-article" resolution data in AQS In-Scope Open None
In Progress 172009 Add referer to WebrequestData Screep Open None
In Progress 132691 Clean up property passing in dashiki In-Scope Open None
In Progress 161185 Pivot "MediaWiki history" data lake: Feature request for "Event Users" In-Scope Open None
In Progress 125015 Requests to (hard) redirect pages return their target's contents but are counted as pageviews to the redirect page In-Scope Open None
In Progress 142408 Better publishing of Annotations about Data Issues In-Scope Open None
In Progress 170990 Add index to mediawiki_page_create_1 table Screep Open None
In Progress 156657 dashiki should execute tests on jenkins In-Scope Open None
In Progress 114469 Investigate US traffic by state normalized by population In-Scope Open None
In Progress 115634 --- Items above are triaged ----------------------- In-Scope Open None
In Progress 158334 Make Spark 2.1 easily available on new CDH5.10 cluster In-Scope Open None
In Progress 166712 Remove logging from labs for schema https://meta.wikimedia.org/wiki/Schema:CommandInvocation In-Scope Open None
In Progress 126290 Improve joining mechanism between webrequest data and edit data for i.e. sampling pageviews In-Scope Open None
In Progress 145828 passport-mediawiki-oauth doesn't support callback parameter In-Scope Open None
In Progress 160630 Please update Tulu Language(tcy)in Wikipedia Statistics. In-Scope Open None
In Progress 170826 Enable base::firewall on stat boxes after restricting Spark REPL ports. Screep Open None
In Progress 149736 Bikeshed what events should be exposed in public EventStreams API In-Scope Open 0.0
In Progress 131127 Browser Reports. Break down "Other" bucket a little more? In-Scope Open None
In Progress 157435 Review ACLs for the Analytics VLAN In-Scope Open None
In Progress 165233 Data Lake edit data missing for many wikis In-Scope Open None
In Progress 125345 Many error 500 from pageviews API "Error in Cassandra table storage backend" In-Scope Open None
In Progress 132405 Collect information about how we collect user statistics in one place In-Scope Open None
In Progress 163177 can't compile numpy on stat1004 In-Scope Open None
In Progress 166937 Broken /a/refinery-source/guard/run_all_guards.sh script on stat1002 In-Scope Open None
In Progress 147196 EventLogging sees MobileWikiAppFindInPage parsing errors In-Scope Open None
In Progress 156965 Remove user_agent_map from pageview_hourly long term In-Scope Open None
In Progress 76782 security review of Wikimetrics {dove} In-Scope Open None
In Progress 116188 Add help page in wikitech on what the analytics team can do for you similar to release engineering page In-Scope Open None
In Progress 166689 Provide top domain and data to truly test superset In-Scope Open 8.0
In Progress 141117 Report on Wikimedia's industry ranking In-Scope Open None
In Progress 170650 [Investigate] Hadoop integration for ORES training Screep Open None
In Progress 120330 Bot to call global metrics to event page {kudu} In-Scope Open None
In Progress 134231 Wikipedia Clickstream dataset. Programmatic Access In-Scope Open None
In Progress 166877 Bring the Editor Engagement Dashboard back In-Scope Open None
In Progress 173513 Create a database on the wikireplica servers called "datasets_p" Screep Open None
In Progress 172579 Weird performance of sqoop job on Edit Reconstruction Screep Open None
In Progress 92502 Dashboard Directory Design Feedback In-Scope Open None
In Progress 136125 Dashiki, Unique Devices and Pageview data breakdown doesn't work if any of the items are not available for the project In-Scope Open None
In Progress 167907 Incorporate data from the GeoIP2 ISP database to webrequest In-Scope Open None
In Progress 159269 Clean up remaining Dashiki configs on meta In-Scope Open None
In Progress 157697 Add error component to Dashiki In-Scope Open None
In Progress 126281 [Regression] stats.wikipedia.org redirect no longer works ("Domain not served here") In-Scope Open None
In Progress 159337 Automate refinery jar cleanup In-Scope Open None
In Progress 102079 Metrics about the use of the Wikimedia web APIs In-Scope Open None
In Progress 110459 Allow clicking on links in annotations In-Scope Open None
In Progress 164008 Update druid to latest release In-Scope Open 13.0
In Progress 171117 Track zim file downloads Screep Open None
In Progress 116678 Country mapping routine for proxied requests In-Scope Open None
In Progress 136732 Puppetize job that saves old versions of geoIP database In-Scope Open None
In Progress 159046 Track page views by page ID rather than title (handles moved pages) In-Scope Open None
In Progress 156844 Prep to decommission old dbstore hosts (db1046, db1047) In-Scope Open None
In Progress 121912 Better redirect handling for pageview API In-Scope Open None
In Progress 44360 Provide regular cross-wiki reports on flagged revisions status In-Scope Open None
In Progress 112846 Display automata and humans separately on zero results rate graph In-Scope Open None
In Progress 150483 Set up a fake Pageview API endpoint for the beta cluster In-Scope Open None
In Progress 146911 Quantify false positives when filtering for number of distinct user agents per page in top pages computation In-Scope Open None
In Progress 93217 Troubleshoot Wikimetrics RAE reports In-Scope Open None
In Progress 164280 Host API for token persistence dataset In-Scope Open None
In Progress 161149 Provide edit tags in the Data Lake edit data In-Scope Open None
In Progress 90240 Could it be that the geo IP matching is not accurate for Africa? In-Scope Open None
In Progress 157092 Support per-topic configuration in EventBus service In-Scope Open None
In Progress 142395 Improve initial load performance for dashiki dashboards In-Scope Open None
In Progress 167608 Add caused_by_user_text to mediawiki_page_history In-Scope Open None
In Progress 111611 Accented letters seem to be rejected in cohort names In-Scope Open None
In Progress 136126 Better menu for metrics In-Scope Open None
In Progress 163134 Reportupdater writes a README in the output folder In-Scope Open None
In Progress 171988 NDA, MOU and LDAP (analytics cluster) for Shilad Sen Elaborated Open None
In Progress 167290 Sqoop wbc_entity_usage from all wikis into hadoop (HDFS) In-Scope Open None
In Progress 171203 Run eventlogging purging script on beta labs to avoid disk getting full Screep Open None
In Progress 163380 Support posting Jobs to EventBus simultaneously with normal job processing In-Scope Open None
In Progress 167039 Upgrade Kafka on main cluster with security features In-Scope Open None
In Progress 106034 Too few page views for June/July 2015 In-Scope Open None
In Progress 159584 Secure hue and other private data access sites with 2FA In-Scope Open None
In Progress 162933 Endpoint for average view rate in Pageview API In-Scope Open None
In Progress 127995 Create table in hive with a continent lookup for countries In-Scope Open None
In Progress 6537 Categories created using Tamil words not recognised in stats In-Scope Open None
In Progress 141506 Suddenly outrageous higher pageviews for main pages In-Scope Open None
In Progress 173492 Tune Varnishkafka delivery errors to be more sensitive Screep Open None
In Progress 170019 Script that synchronizes EL purging white-list with schema talk pages Screep Open None
In Progress 76914 User reads result of validation after creating a cohort In-Scope Open None
In Progress 167180 Emit revision-score event to EventBus and expose in EventStreams In-Scope Open None
In Progress 135762 A/B Testing solid framework In-Scope Open None
In Progress 173514 Document the process for importing a new "datasets_p" table Screep Open None
In Progress 164500 Add jobs for druid compaction for pageviews data set In-Scope Open None
In Progress 150439 Tests for swagger spec stream routes in EventStreams In-Scope Open 5.0
In Progress 166248 Upgrade Analytics Cluster to Java 8 In-Scope Open None
In Progress 127850 Improve Hue user management In-Scope Open None
In Progress 143819 Data request for logs from SparQL interface at query.wikidata.org In-Scope Open None
In Progress 172410 Phase out and replace analytics-store (multisource) Screep Open None
In Progress 165560 Artificial spike in offset of unique devices from November to February 6th on wikidata In-Scope Open None
In Progress 119897 Create cron on 1002 to remove CirrusSearchRequest partitions In-Scope Open None
In Progress 143689 Bookmarkable date filters for browser stats dashboard In-Scope Open None
In Progress 159840 Alarm on data quality issues In-Scope Open None
In Progress 166339 Are watchlists dead? In-Scope Open None
In Progress 95456 "Create Report" button does not appear when uploading a new cohort In-Scope Open None
In Progress 130832 cdh::hadoop::directory (and other hdfs puppet command?) should quickly check if namenode is active before executing In-Scope Open None
In Progress 161635 Storage for banner history data In-Scope Open None
In Progress 169900 ---------------- Discussed above -------------------- Screep Open None
In Progress 116387 Refactor webrequest_source partitions and oozie jobs In-Scope Open None
In Progress 120036 Vital Signs: Please make the data for enwiki and other big wikis less sad, and not just be missing for most days In-Scope Open None
In Progress 117236 Track overall traffic, without any filtering, broken down into major categories, for internal use. In-Scope Open None
In Progress 151904 User limits for stat machines. Limit space on /home dir and possibly /tmp In-Scope Open None
In Progress 161146 Provide historical redirect flag in Data Lake edit data In-Scope Open None
In Progress 118839 Productionize Pageview_sanitization hive code with Oozie job and refinery inclusion {hawk} In-Scope Open 8.0
In Progress 110903 Make webperf eventlogging consumers use eventlogging on Kafka In-Scope Open None
In Progress 144639 Propose metrics along with qualifiers for the press kit In-Scope Open None
In Progress 131158 Describe threat model for sanitized pageview data {mole} In-Scope Open 13.0
In Progress 134524 Pageview API: Limit (and document) size of data you can request In-Scope Open None
In Progress 169672 Bucketize userEditCount in EL instrumentation Screep Open None
In Progress 137454 Bot from an Azure cloud cluster is causing a false pageview spike (can we identify as bot?) In-Scope Open 8.0
In Progress 133575 Provide weekly top pageviews stats In-Scope Open None
In Progress 168648 Productionize analysis of editcount vs per_user_revision_count In-Scope Open None
In Progress 71145 Story: AnalyticsEng has editor_day table in labsdb In-Scope Open None
In Progress 151211 kafka alarms audit In-Scope Open None
In Progress 152546 de-duplicate archive records matching revision records in mediawiki_history In-Scope Open None
In Progress 172304 WiViVi Broken in Firefox 50 (Linux only) Screep Open None
In Progress 173486 Investigate Geowiki check_web_page.sh alerts for data quality Screep Open None
In Progress 113695 Clean the code review queue of analytics/wikistats In-Scope Open None
In Progress 117290 Create a tool that can read the elements of a wiki template and call the API {kudu} In-Scope Open None
In Progress 114884 Some special characters break Wikimetrics' encoding {dove} In-Scope Open None
In Progress 136858 Beeline does not print full stack traces when a query fails {hawk} In-Scope Open None
In Progress 150713 Provide filterable line graph for browser-family/browser-major In-Scope Open None
In Progress 158166 Discuss labsdb visibility of rev_text_id and ar_comment In-Scope Open None
In Progress 145197 WMF pageview API (404 error) when requesting statitsics over around 1000 files on GLAMorgan In-Scope Open None
In Progress 162618 Measure portal pageviews In-Scope Open None
In Progress 119996 Have dashiki read and write GET params to pass stateful versions of dashboard pages {crow} In-Scope Open None
In Progress 166833 Produce webrequests from varnishkafka to Kafka with Kafka message timestamp set to configurable content field In-Scope Open None
In Progress 136127 Breakdowns should be bookmarkeable In-Scope Open None
In Progress 167992 rack/setup/install new kafka nodes kafka-jumbo100[1-6] In-Scope Open None
In Progress 118402 Make AQS return 0 instead of no values {slug} In-Scope Open None
In Progress 143743 Set up the foundation for the ReviewStream feed In-Scope Open None
In Progress 118310 Expose the results of the global metric at a public link, that's available immediately for the API {kudu} In-Scope Open 8.0
In Progress 89397 Investigate getting redirect_page_id as an x_analytics field using the X analytics extension. {pika} In-Scope Open None
In Progress 168550 Productionize Tranquility (or shut it off) In-Scope Open None
In Progress 171011 Update EventStreams to service-template-node v0.5.2 Screep Open None
In Progress 172532 Refactor analytics cronjobs to alarm on failure Screep Open None
In Progress 173604 Reportupdater: do not write execution control files in source directories Screep Open None
In Progress 107250 Remove links in wikistats to minnan.wikipedia.org In-Scope Open None
In Progress 138505 Split opera mini in proxy or turbo mode In-Scope Open None
In Progress 173094 Remove stat1002 Screep Open None
In Progress 172032 Pagecounts-ez not generating Elaborated Open None
In Progress 121286 Central repository of global metrics reports {kudu} In-Scope Open None
In Progress 160311 Sort inconsistency in AQS timestamp behavior In-Scope Open None
In Progress 171626 rack/setup/install druid100[456].eqiad.wmnet Screep Open None
In Progress 146774 Add external link to tabs layout In-Scope Open None
In Progress 170606 Add Accept header to webrequest logs Screep Open None
In Progress 126501 Load Avro schemas from configurable external path In-Scope Open 13.0
In Progress 158896 Provide a spark job processing history and text to extract citations diffs In-Scope Open None
In Progress 166331 Pivot - Article Page Views In-Scope Open None
In Progress 155507 Meta-statistics on MediaWiki history reconstruction process In-Scope Open None
In Progress 165309 Create small sample mediawiki-history table in MariaDB In-Scope Open None
In Progress 89453 Hand off of Christian's MaxMind geolocation databases repository In-Scope Open None
In Progress 126279 Add pivot parameter to tabular layout graphs {lama} In-Scope Open None
In Progress 164259 Add VSL error counters to Varnishkafka stats In-Scope Open None
In Progress 112284 Create new table for 'referer' aggregated data In-Scope Open None
In Progress 152222 Make aggregated MediaWiki Pingback data publicly available In-Scope Open None
In Progress 89726 Analyze difference in Edit Schema "bounce rates" across wikis {lion} In-Scope Open None
In Progress 146130 Inconsistent Cassandra disk load shown in metrics and nodetool status In-Scope Open None
In Progress 126218 Replicate wikitech wikis to analytics-store.eqiad.wmnet In-Scope Open None
In Progress 120713 delete useless wikimetrics.report or cohort records In-Scope Open None
In Progress 128623 Purge all Schema:Echo data after 90 days In-Scope Open None
In Progress 169674 Fix EventLogging editCountBucket fields historically Screep Open None
In Progress 138207 [Open question] Improve bot identification at scale In-Scope Open None
In Progress 148053 Switch to fetch away from jquery In-Scope Open 13.0
In Progress 142535 Find out what happens to the old rows in the revision table In-Scope Open None
In Progress 124319 Add json linting test for schemas in mediawiki/event-schemas In-Scope Open None
In Progress 108850 Set up auto-purging after 90 days {tick} In-Scope Open None
In Progress 92875 Add page_id and namespace to X-Analytics header in App / api requests In-Scope Open None
In Progress 113234 Update passport-mediawiki module URLs and documentation In-Scope Open None
In Progress 150028 RFC: Requirements for analytics stats processor In-Scope Open None
In Progress 163797 add a more friendly message to ladp authentication box for pivot In-Scope Open None
In Progress 161731 Create reliable change stream for specific wiki In-Scope Open None
In Progress 71462 Wikimetrics is not supporting mlwiki cohort In-Scope Open None
In Progress 90759 Create Daily & Monthly pageview dump with country data In-Scope Open None
In Progress 147967 The WMF-Last-Access Set-Cookie header should follow RFC 2965 syntax rather than the pre-RFC Netscape format In-Scope Open None
In Progress 166249 Bulk/Batch event endpoint In-Scope Open None
In Progress 112009 Re-baselining checkpoints periodically In-Scope Open None
In Progress 124082 As an end-user I shouldn't see non-articles in the list of top articles In-Scope Open None
In Progress 149594 Delete stale topics from main Kafka clusters In-Scope Open None
In Progress 114199 Upgrade eventlogging servers to Jessie In-Scope Open None
In Progress 164596 Provide uniques offset/underestimate breakdowns in AQS In-Scope Open None
In Progress 142073 Improve user management for AQS In-Scope Open 5.0
In Progress 156037 Load cirrussearch data into druid In-Scope Open None
In Progress 170145 Add parsedcomment to recentchange stream Screep Open None
In Progress 138396 Create ops dashboard with info like ipv6 traffic split In-Scope Open None
In Progress 173493 Tune Kafka logs to register clients connected Screep Open None
In Progress 157088 [EPIC] Develop a JobQueue backend based on EventBus In-Scope Open None
In Progress 115042 Make banner impression counts available somewhere public In-Scope Open None
In Progress 121262 Display global metrics report results on same page as report inputs {kudu} In-Scope Open None
In Progress 148656 Edit analysis dashboard Failures by User Type chart does not update correctly In-Scope Open None
In Progress 141010 Adding top counts for wiki projects (ex: WikiProject:Medicine) to pageview API In-Scope Open 21.0
In Progress 159264 Prototype counting of requests with real time (streaming data) In-Scope Open None
In Progress 172832 Investigate use-cases for delayed job executions Elaborated Open None
In Progress 138426 Spike: Evaluate alternatives to varnishkafka: varnishevents In-Scope Open None
In Progress 126494 Look into encrypting logs sent between mediawiki app servers and kafka In-Scope Open None
In Progress 164593 Provide unqiues estimate/offset breakdowns in AQS In-Scope Open None
In Progress 113817 Connect Hadoop records of the same request coming via different channels In-Scope Open None
In Progress 166679 Reinstate a subset of reports removed from the reportcard until WikiStats 2.0 is back In-Scope Open None
In Progress 160679 Test pushing EventLogging through the ELK stack In-Scope Open None
In Progress 153033 Drop MoodBar tables from all wikis Screep Open None
In Progress 98831 Honor DNT header for access logs & varnish logs In-Scope Open None
In Progress 142139 Top API user agents stats In-Scope Open None
In Progress 167427 Configure superset to query mysql slaves In-Scope Open 5.0
In Progress 173512 Create a phabricator project called "wikireplica-datasets" Screep Open None
In Progress 164377 [Spike] Store article quality data inside hadoop and make AQS outputs a public API In-Scope Open None
In Progress 87604 Add ops-reportcard dashboard with analysis that shows the http to https slowdown on russian wikipedia In-Scope Open None
In Progress 103726 Report page views for labs instances In-Scope Open None
In Progress 173511 Implement technical details and process for "datasets_p" on wikireplica hosts Screep Open None
In Progress 170850 Visualize page create events for all wikis Elaborated Open None
In Progress 161027 Puppetize event schema topic configuration In-Scope Open None
In Progress 137321 Run ETL for wmf_raw.ActionApi into wmf.action_* aggregate tables In-Scope Open None
In Progress 164348 Investigate the use of local_quorum for AQS In-Scope Open 5.0
In Progress 122245 REST API entry point web request statistics at the Varnish level In-Scope Open None
In Progress 88775 Add mediacounts to pageview API In-Scope Open None
In Progress 168554 Default hive table creation to parquet - needs hive 2.3.0 In-Scope Open None
In Progress 163113 Adding breakdowns to mw edit history reconstruction: wiki projects, categories (cohort) In-Scope Open None
In Progress 61832 Remove ad-hoc UA logging from existing schemas In-Scope Open None
In Progress 117480 Provide machine readable directory indexes on http://datasets.wikimedia.org/aggregate-datasets/ In-Scope Open None