...and here's this week's Matrix Live! Turns out it's our 1 year anniversary of starting Matrix Live, so here's a bumper edition for everything which is flying around as we move to ship a stable 'r0' release of Matrix across all APIs! Get all the gory details over at https://matrix.org/blog/2018/07/13/this-week-in-matrix-2018-07-13/
2018-07-13 17:32:16 +0000 UTC View Post
We completely forgot to circulate the last Matrix Live two weeks ago - sorry! But here it is, for posterity :) Twinned with https://matrix.org/blog/2018/07/05/this-week-in-matrix-2018-07-05/
2018-07-13 17:23:13 +0000 UTC View Post
Here's this week's Matrix Live! All the gory details are over at https://matrix.org/blog/2018/06/15/this-week-in-matrix-2018-06-15/.
Thanks once again for supporting Matrix - it's massively massively appreciated :)
2018-06-15 18:41:47 +0000 UTC View Post
Aaaaaall the details on community projects in the TWIM blog here: https://matrix.org/blog/2018/06/08/this-week-in-matrix-2018-06-08/
Riot/Web
- 0.15.5 rc1 is out with translation, and fixing some issues small issues like page change metrics exploding tor, and.... wait for it... the ability to click out of the room settings to close them \o/
- Dave: progress on ability to disassociate 3pids from mxids when user asks to be gdpred
Riot/Mobile
- Android: * stability fixing crashes and adding more tools to control code quality * the community on android adds a more readable display of keys and a floating actions menu is coming - iOS: working on perf. On stability too (like killing build warnigs). Users can now re-request keys when they have UTCs
Synapse - 2 releases!
- Changes for Synapse 0.31.0
⁃ Most notable change from v0.30.0 is to switch to python prometheus library to improve system stats reporting. WARNING this changes a number of prometheus metrics in a backwards-incompatible manner.
⁃ There are still many changes being made relating to the Python 3 migration.
- For Synapse 0.31.1
* v0.31.1 fixes a security bug in the “get_missing_events“ federation API where event visibility rules were not applied correctly.
Dendrite
- Very close to having full blown AS working!! blocked behind a few small things needing to be to be cleared up but almost here. Have been testing with Half-Shot’s Discord bridge. Still work to do before AS can do anything they want and Dendrite to federate but basics are here
Bridges
- HS is here and attacking the IRC bridge! lots of tracing for now, but also some PRs which have been here for ages, as well updating outdated packages
Stickers
- New stickers ! Smilies by Lukas Adam
And Matrix-search for all your e2e search needs is being tested!
Real Soon Now themed...
More gory details at https://matrix.org/blog/2018/06/01/this-week-in-matrix-2018-06-01/ especially community updates, but in this video:
* GDPR enforcement is deployed without disaster
* Riot/Mobile Releases on their way adding the ability to deactivate account, fixing regressions, and adding the ability to send stickers
* "Advocay Dept"
* Work on Matrix.org website: new FAQ and new structure, new guides Real Soon Now!
* Sticker packs contribution flow improvement, thanks to lcp for being our guinea pig!
* Matrix roadmap up Real Soon Now!
* Ops:
* Status page almost up
* AWX
* Back-end:
* Amber on Synapse perf and Python 3 with Notafile
* Uhoreg on verification UX and cross-signing Real Soon Now!
* Dendrite: anoa showing off sending to 2 ASes! Thanks to APWhitehat and CromFr for their help :)
* Erik is chunking, trying to get them faster, running on his server for a week
2018-06-01 18:23:09 +0000 UTC View Post
Happy GDPR day everyone!! All the gory details are over at https://matrix.org/blog/2018/05/25/this-week-in-matrix-2018-05-25/
2018-05-26 01:49:46 +0000 UTC View Post
Gory details at https://matrix.org/blog/2018/05/18/this-week-in-matrix-2018-05-18/
2018-05-18 17:48:40 +0000 UTC View Post
A particularly waffly 30 minute Matrix Live! For all the gory details head over to This Week In Matrix: https://matrix.org/blog/2018/05/04/this-week-in-matrix-2018-05-04/
2018-05-04 17:22:06 +0000 UTC View Post
For full details, check out This Week In Matrix!
2018-04-27 17:55:34 +0000 UTC View Post
This week's episode is paired with our first ever This Week In Matrix blog post over at https://matrix.org/blog/posts?p=3042 :D
2018-04-20 16:54:46 +0000 UTC View Post
Riot/Web:
* 0.14 is out!!! (and so is 0.14.1)
* The Great Relayering is almost finished
* Lots of bugfixing and polishing happening post 0.14; reporting telemetry too.
Riot/Mobile:
* Supporting L'État Français
* Notifs on Android UX
Synapse
* 0.27.3 was released as a pretty major update, required for Riot 0.14 - supports joinable groups, better phonehome stats, and yet more perf fixes.
* Fixed a nasty quoting bug which killed Parity's server :(
* 0.27.4 was released today to fix a dependency bug.
* Please torture test on private networks, not the public network!!
* Caught up on PRs (to some extent!)
* Ansible playbooks in final stage of testing (repo will be opened asap)
Dendrite
* PRs from Crom and ElyKar
* Otherwise, still trapped in Synapse
Integrations
* Folks have been experimenting with stickers on develop (currently there's a regression though)
Spec
* Being hijacked by Riot/Web work.
Community stuff!
* Ben started and is reworking Try Matrix Now page
* New format coming up for Matrix Live (sort of)!
* Starting next week: "This week in Matrix" blog, spanning the whole community: please come share your updates in #thisweekinmatrix:matrix.org! - we'll then talk through some of the highlights here alongside the stuff the core team's been up to (and so where Patreon/Liberapay/etc $ is going).
Synapse
Perfomance improvements to JSON serialisation - Rich
Continue to work on state resolution performance improvements - Erik
Performance improvements for IRC bridging - sorry for the lagging!
Supporting Riot 0.14 in the join groups feature.
Interesting community project to port synapse to python 3 - thanks notafile!
Dendrite - all community driven; Erik spoke at Go London on the subject of Dendrite
Ops - Working on Ansible play books to standardise deploys
Riot web - finish joinable bit, running through the last bit of review, agreeing on an API took longer than expected, so we should be getting there: expecting the release next week...
Sticker packs on Riot Web develop! Behind the LABS flag in Settings.
Riot Android
Notifs: Manu has been doing a complete analysis and now has a plan of attack, which is basically going back to the way it worked before Android 8, while supporting Android 8, as a short term solution; and planning a larger refactor when our new Android dev Benoit will be joining us in 10 days!
Audrey implemented Sticker packs on develop
Riot iOS - Giom started doing sticker packs but not ready yet
Ben joined us as a Dev Advocate is working on making https://matrix.org/docs/projects/try-matrix-now.html a bit more usable, gathering feedback from folks who already looked at it, including Uhoreg
Looking forward to improve all our interfaces with the community, both developers focused content, but also move forward the governance stuff and how we can open up the project share more the responsibility with the community.
2018-04-06 16:54:17 +0000 UTC View Post
Riot
0.14 delayed by last minute improvements to communities to allow self-joining (thanks to some robust feedback on the release candidates from Elliptic supporters)
Working a formal roadmap and scope for 0.15
0.15 should have:
* stickerpacks (just merged to develop!)
* jitsi by default (at last!)
* performance telemetry gathering
Stretch goals are fixing the react-sdk/riot-web layering split(!!!!!!), member lazyloading and e2e cross-signing.
Riot/Mobile
* Emergency releases to fix a Synapse DoS vector concerning redactions
* And then an emergency release on Android to fix the emergency release - please upgrade to 0.8.5!
* Sticker packs implemented
* Nightmare android push notification wrangling continues
Synapse
* Synapse 0.27 is out (currently on 0.27.2)! if you haven't upgraded, please do so.
* Major perf improvements on the horizon:
* Lots of JSON benchmarking - richvdh got canonicaljson to run 3x faster
* Erik’s been working on incremental state resolution calculations. Looking very promising so far; test jig shows a 9x speedup and could have similar resource improvements
* notafile has been converting from py2 to py3 - which should reduce RAM usage by 2-3x and also improve GC and memory management in general. All UTs pass!! But sytest doesn’t yet. Huge thanks to notafile for pushing this along!
* GDPR compliance on the horizon: our plan atm is to add an API to let vape a user from your server (and block them from resyncing). In future we'll look at a megaredact API.
* Official Ansible playbooks are in dev.
* Operational messes caused by DoSes from mobile clients.
Dendrite
* Synapse resurgence continues to distract the core team from Dendrite (although we're speaking at the London Go meetup about Dendrite on Wed April 5th!)
Bridges
* Freenode had a disaster last Thursday & Friday - sorry for those who got caught in the outage; it's stable again now and should behave better thanks to all the Synapse perf work.
Spec
* We've had some thoughts on Matrix and MLS (Messaging Layer Security).
* Forgot to mention (in the video) that there's really exciting work happening on a general C++ wrapper for olm called matrix-olm-wrapper written by ajberchek for use in nheko and other clients!
* Ben joins this coming week to focus on improving our support of the wider Matrix community! He’ll need to come up to speed first but watch this space.
* We've also started publishing the notes of our internal sync meetings - keep an eye on Patreon if you're Polynomial or Elliptic for the details.
2018-04-02 21:59:39 +0000 UTC View Post
Riot/Web
* 0.14 RCs all week; final RC due today.
* Fixing up /app to ensure folks who test RCs don't implode
* Lots of polish based on RC feedback
* Stickerpacks are reviewed and ready for 0.15
* Big UI/UX Redesign is under way, including improving Communities
Riot/Mobile
* Trying to resolve the notification problems on Android
* Stickers implementation
* 3D touch problems on iOS
Synapse/Dendrite
* Almost entirely broken by operational fallout from last weekend's outage
* A bit of progress on membership lazy loading and some sytests
* Perf is relatively improved, but freenode is still sometimes falling behind a bit.
* There may be hope on the horizon for improved performance though.
* Synapse 0.27 is due out on Monday!
Spec
* Still haven't got back to event formats & .well-known URIs :(
* Went to IETF and talked about Message Layer Security (MLS)
Matrix Live S02E10 and S02E11
We've been ill.
Riot/Web
* Huge amounts of prep for 0.14; so close now we can taste it!
* Lazy-loading membership experiments
Riot/Mobile:
* 0.6.12 was just released on iOS!
* Mainly stability and perf work, but contribution from Joey Watts for quick replies!
* New android release too, improving the mess with notifications.
Synapse
* Where to start?
* Ops hell with running out of CPU room; malformed events; running out of disk space; a DDoS; freenode netsplits
* event_creator work is almost complete; member changes are now split out!!
* next step is to move state resolution to the worker too
* 0.27-rc1 is out
* work on official ansible playbooks has begun!
Dendrite
* Lots of activity driven by the community - thank you! We are trying to catch up on PRs there as much as possible
Spec
* Some work on lazy-loading optimisation proposals
* Other proposals (governance, event formats, .well-known URIs) haven't progressed much.
Widgets
* sticker packs are ready to go and look great!
Sorry for running late - we've been at Elevate.at!
Riot/Web
* Gearing up for 0.14 release still. 24 issues in the milestone; 17 are closed; 7 remain - follow along on the github milestone
* Good news is that LeftLeftPanel (also TagPanel or GroupPanel or FilterPanel) is good to go.
* However, we are still seeing major performance issues (both CPU & RAM) which we're wanting to close before we ship.
* Finally, we're trying to sneak in a new workaround for UISIs (undecryptable messages), where users can manually press a button to rerequest keys if they're missing.
Synapse:
* We ran out of CPU on the synapse master yet again due to increasing traffic levels - the worst sideeffect (other than general latency) is that Freenode membership changes fall behind during west-coast US business hours, meaning newly joined users on the IRC side don't appear and aren't bridged to Matrix.
* So, loooooooads of perf work happening to fix this!
* Splitting out push calculations to happen on the new 'event creator' workers
* Profiling the master with Theseus to find other hotspots; e.g. Read Markers (now optimised with more cacheing)
* Rich vdH has been working away on state resets (and ops hell)
* Synapse 0.27 on the horizon once we've fixed the CPU fun.
Dendrite:
* Progress happening in the community - thanks to Anoa and others; we're going to be back as soon as Synapse 0.27 is out.
Riot/Mobile:
* We announced all the new releases last week!
* Shipped a quick update on iOS to fix a problem with blank groups.
* Quick Replies are here in notifications, on dev, thanks to a Status Open Bounty submission from Joey Watts!
* Swift 4 support on iOS SDK was contributed/fixed by John Flanaghan at Spok
* We're now in a bugfixing & maintenance sprint!
Integrations:
* Sticker packs are done pending review!
Spec:
* Much discussion of .well-known URLs. Huge thanks to uhoreg for shepherding the spec proposal through whilst trying to incorporate feedback from the wider community.
* Matthew spent last weekend working on governance docs for Matrix.org for a more open community contribution process - looking at inspiration from Rust and others.
Hiring! Come work on Matrix!!
2018-03-03 14:36:52 +0000 UTC View Post
Riot/Web
* Preparing for 0.14 release
* Finalising the LeftLeftPanel!
* Memory Perf (reduced memory consumption by about 30% so far)
* Fixing anything which has regressed since 0.13 (e.g Tinting)
* Coming up:
* Room-switching Perf
* Fixing perf slowdowns when receiving messages
Riot/Mobile
* 0.8 is out on Android!
* FDROID IS BACK!! (Thanks to Marcus, Mathjis and the Fdroid team!)
* Welcome to Audrey, and thanks to Giom for switching to Android to help too!
* URL previews
* Adds initial support for communities!
* Adds flair!
* fixed the missed notifications, issue observed mostly on Android 8. We prevent the app from being killed while it runs in background by introducing a temporary notification "Synchronizing" (displayed if there is no notification yet).
* fixed the duplicate notifications observed in Fdroid
* Room notification level: you can now select mute/mentions-only/normal/noisy
* 0.6.10 has been pending developer on iOS since Monday… uh, we should probably release it.
* Initial support for Communities and flair here too!
* Fixes to nightmare spontaneous logout issues on iOS11 if you lose battery
Synapse
* Event creator workers are here! But still some work to be done to actually make them perform..
* ...Meanwhile we ran out of CPU (and RAM) on the synchrotron side
* I want to add a replication fan-out worker...
* S3 content upload is also here, and even being used on matrix.org to save diskspace.
* Introduction of Compact Events to save some RAM.
* Generally lots of ops :|
Dendrite
* PRs from Dumbledor (federation) and Anoa (AS)
* Otherwise core dev is still stalled by Synapse hell - sorry.
Integrations
* Sticker pack final PRs are open! Nearly there...
Spec
* Extensible format nightmare
* State resets
* Formal spec proposal for widget API (slightly more refined than the actual implementation being used for sticker packs, but we’ll update to use it)
Other stuff
* Matthew fixed the smearing in the vrdemo
* Our office is finished! and we even have an office dog!
Looks like we forgot to post the livestream URL for this morning's internal sync - sorry!
2018-02-12 21:47:26 +0000 UTC View Post
Riot/Web
* 0.13.5 is out today, fixing an XSS vulnerability - thanks to walle303 for finding and disclosing it responsibly!
* Lots of perf work
* Offline mode
Riot/iOS
* A new fix to spontaneous logouts
* New release almost ready to go live
* Communities perf work
* Flair!
Synapse
* Lots of perf and ops work
* Split-out of sender path is almost complete (event_creator worker)
* Fixing issues with purging events
* Much running around handling diskspace outages for both postgres & the media store
Dendrite
* No progress, but we hope to get back to it at last next week
Widgets
* Yet more progress on StickerPacks
Spec
* Lots of discussions about improving event structure
* ...and discussing m.calendar.request events from Half-Shot.
Hiring:
* If you've got this far, then if you want to work fulltime on any of this give us a shout!
* Particularly on Dendrite and Riot/Web and Android.
Thank you to everyone who is continuing to support us!
2018-02-09 18:33:54 +0000 UTC View Post
Hi folks; here's the live stream of our internal sync. URL for those who want to participate are in the Elliptic room :)
2018-02-05 10:36:27 +0000 UTC View Post
Live from The Matrix Corridor (next to The Realtime Lounge) at FOSDEM 2018!!
* In which we chat to folks from the Matrix community who are hanging out near the Real Time lounge...
* Riot/Web:
* A bit more LeftLeftPanel work, but we got a bit distracted doing the FOSDEM 3D calling VR demo instead...
* Riot/Mobile:
* More communities work!
* Piwik support on iOS!
* Android is on hold for a few weeks whilst we play musical chairs in the team...
* Synapse:
* Lots of ops work
* Dendrite:
* Hijacked by Synapse
* Widget:
* Stickerpacks and scalar infrastructure continues
2018-02-04 15:45:00 +0000 UTC View PostSo we’re delaying it until tomorrow :)
2018-02-02 17:59:09 +0000 UTC View Post
Funding:
The news is out - huge thanks to Status.im for massive investment in New Vector, securing our long-term funding!! https://matrix.org/blog/2018/01/29/status-partners-up-with-new-vector-fueling-decentralised-comms-and-the-matrix-ecosystem/
We're going to stop putting Matrix Live behind a paywall :)
We're hiring:
* UI/UX designer(s)
* Android devs
* Frontend dev (React)
* Backend devs (Go/Python/Node)
* Site Reliability Engineers
* Community Manager
* Crypto specialists
Riot/Web:
LLP perf work and new drop & drag all coming together...
Riot/iOS:
Still investigating push weirdnesses
Still working on Groups
Riot/Android:
URL previews are here on develop!
Notification improvements
We need help - Android folks
Synapse:
Ability to whitelist signup by email address
Ability to disable federation other than to specific domains, at last!
Some breakthroughs on the horizon with state resolution performance
Dendrite:
Eclipsed by Synapse for a change. Did we mention we're hiring Go experts for Dendrite?
Bridges:
Updated the slack bridge for the first time since July thanks to erdnaxeli's maintainership!
Widgets:
Still working away on refining widget API to support Sticker Packs!
...watch this space :)
2018-01-27 07:36:55 +0000 UTC View PostHeads up that we’re skipping this week’s internal sync as most of the team is out this week, recharging :)
2018-01-22 08:57:38 +0000 UTC View Post
Matrix Live S2E03
Funding:
* Look, an eagle! https://matrix.org/eagle.jpg
* Massive thanks once again to everyone who's donating to support Matrix - we're continuing to set up Matrix.org Foundation
Synapse:
* Lots of remedial work after last week's meltdowns
* All new media repository code to handle the fact we were about to run out of disk space; it's now modular and supports saving to S3 as well as migrating old content to older stores
* Lots new metrics to help debug future meltdowns
* Lots of progress on splitting the sender path into multiple workers
* ...and finally, started work on fundamentally speeding up state resolution, having discovered some of the stupid bugs which cause it to chew RAM and CPU
Dendrite:
* Basically on hold whilst we get Synapse back in its box for another few months
Riot/Web:
* Moving all the device tracking stuff over to indexeddb
* Massive improvements to RoomPanel, TagPanel performance - and drop & drag
* PR catchup
Riot/Mobile:
* iOS: Communities work continuing
* Otherwise stuck doing consulting work for some New Vector customers
Widgets:
* Still working a lot on stickers & refining the overall sticker setup.
2018-01-19 20:24:36 +0000 UTC View Post
