summaryrefslogtreecommitdiffstats
path: root/store
Commit message (Collapse)AuthorAgeFilesLines
* Relax 4k post message limit (#8478)Jesse Hallam2018-03-264-57/+170
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * MM-9661: rename POST_MESSAGE_MAX_RUNES to \0_v1 * MM-9661: s/4000/POST_MESSAGE_MAX_RUNES_V1/ in tests * MM-9661: introduce POST_MESSAGE_MAX_RUNES_V2 * MM-9661: migrate Postgres Posts.Message column to TEXT from VARCHAR(4000) This is safe to do in a production instance since the underyling type is not changing. We explicitly don't do this automatically for MySQL, but also don't need to since the ORM would have already created a TEXT column for MySQL in that case. * MM-9661: emit MaxPostSize in client config This value remains unconfigurable at this time, but exposes the current limit to the client. The limit remains at 4k in this commit. * MM-9661: introduce and use SqlPostStore.GetMaxPostSize Enforce a byte limitation in the database, and use 1/4 of that value as the rune count limitation (assuming a worst case UTF-8 representation). * move maxPostSizeCached, lastPostsCache and lastPostTimeCache out of the global context and onto the SqlPostStore * address feedback from code review: * ensure sqlstore unit tests are actually being run * move global caches into SqlPostStore * leverage sync.Once to address a race condition * modify upgrade semantics to match new db semantics gorp's behaviour on creating columns with a maximum length on Postgres differs from MySQL: * Postgres * gorp uses TEXT for string columns without a maximum length * gorp uses VARCHAR(N) for string columns with a maximum length of N * MySQL * gorp uses TEXT for string columns with a maximum length >= 256 * gorp uses VARCHAR(N) for string columns with a maximum length of N * gorp defaults to a maximum length of 255, implying VARCHAR(255) So the Message column has been TEXT on MySQL but VARCHAR(4000) on Postgres. With the new, longer limits of 65535, and without changes to gorp, the expected behaviour is TEXT on MySQL and VARCHAR(65535) on Postgres. This commit makes the upgrade semantics match the new database semantics. Ideally, we'd revisit the gorp behaviour at a later time. * allow TestMaxPostSize test cases to actually run in parallel * default maxPostSizeCached to POST_MESSAGE_MAX_RUNES_V1 in case the once initializer panics * fix casting error * MM-9661: skip the schema migration for Postgres It turns out resizing VARCHAR requires a rewrite in some versions of Postgres, but migrating VARCHAR to TEXT does not. Given the increasing complexity, let's defer the migration to the enduser instead.
* Timezone feature (#8185)Chris Duarte2018-03-222-0/+8
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Add supported timezones into config Remove Timezone list creation in favor of timezone from configs Add Timezone field to Users table Clean up format of SupportedTimezones in config * Remove unwanted change * Add test for updating user timezone * Add empty map[string]string if Timezone is null * Add EnableTimezoneSelection config * Revert back to map[string]string for ClientConfig * Refactor SupportedTimezones into timezones.json * Include timezones.json in TestConfigFlag * Add timezone api endpoint * Bump varchar size to 256 and setMaxSize in user_store * Refactor LoadConfig to LoadConfig and LoadTimezoneConfig * Remove unnecessary argument in LoadConfig, mail_test * Add test for timezone endpoint * Add license header * Refactor timezones endpoint to system.go * Add system base route to timezone endpoint * db timezone upgrade in db v4.9 * Avoid saving SupportedTimezones to config.json * Add timezonePath support in config * Remove EnableTimezoneSelection from config * Use return statement without return parameter * Refactor test for SupportedTimezones * Check for supportedTimezone != nil instead of using len * Decouple SupportedTimezones out of Config * Fix failing test * Add LastTeamIconUpdate back in upgrade.go * Write timezone config in config_flag_test * Add code fallback for default timezone support
* MM-9770: rewrite getParentsPosts to improve performance (#8467)Jesse Hallam2018-03-162-118/+215
| | | | | | | | | | | | | | | | | | | | * rename variables in testPostStoreGetPostsWithDetails This helps to clarify the structure of the posts under test. * clarify and expand existing testPostStoreGetPostsWithDetails assertions * expand testPostStoreGetPostsWithDetails assertions This verifies that replies to posts in the window, themselves not in the window (because of a non-zero offset) are still fetched. They were previously missing. * MM-9770: rewrite getParentsPosts to improve performance See discussion on ~developers-performance, but the basic idea here is to force the database to use the `PRIMARY` index when fetching posts instead of trying to filter down by channel and doing a scan.
* MM-8839: Adds ChannelType to compliance-related model. (#8424)Martin Kraft2018-03-092-0/+5
|
* Remove query to update channel extra_update_at field on user ↵Joram Wilander2018-03-095-89/+10
| | | | activation/deactivation (#8415)
* MM-9274- Sort Users in Channel by status (#8181)Stephen Kiers2018-03-094-1/+142
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * sort by lastActivity * added status ordering to Users * sort offline before dnd * remove data not needed * added seperate call for when order=‘status’ is on GetUser request * remove PrintLn * styling fix * remove mistake * mistake 2 * better comment * explicit if statemnt * writing tests * removed manually added mocks * generated mock * ICU-668 Added unit tests * style fix * sort by lastActivity * added status ordering to Users * sort offline before dnd * remove data not needed * added seperate call for when order=‘status’ is on GetUser request * remove PrintLn * styling fix * remove mistake * mistake 2 * better comment * explicit if statemnt * writing tests * removed manually added mocks * generated mock * ICU-668 Added unit tests * style fix * reverse dnd and offline * Fixed app.SaveStatusAndBroadcast * Fixed incorrect merge * Fixing incorrect merge again
* Moved team icon upgrade code to 4.9 since it didn't make it in for 4.8 (#8410)Joram Wilander2018-03-081-1/+1
|
* general cleanup (#8387)Chris2018-03-071-2/+0
|
* XYZ-87: GlobalRelay DM Exports do not Include Channel Name (#8275)Jonathan2018-03-072-22/+282
| | | | | | | | | | * Adding ChannelMemberHistory table records when DM channels are created. This ensures that both participants in a DM are shown in compliance export, even if only one of them typed anything * Direct/Group Message channels now get pretty display names for the purpose of compliance exports * Fixed string formatting in t.Fatal calls * Changed uses of ChannelMemberHistory over to ChannelMemberHistoryResult in tests. This should have been done as a part of the work in XYZ-110, but seems to have been missed in this branch for some reason
* Add preparatory upgrade code for 4.9 (#8408)Joram Wilander2018-03-051-4/+11
|
* MM-9664 Add invalidation metrics for store caches (#8340)Joram Wilander2018-03-0511-19/+110
| | | | | | | | * Add invalidation metrics for store caches * Increment session invalidation metric * Fix tests
* PLT-7567: Integration of Team Icons (#8284)Christian Hoff2018-03-015-0/+56
| | | | | | | | | | * PLT-7567: Integration of Team Icons * PLT-7567: Read replica workaround, upgrade logic moved, more concrete i18n key * PLT-7567: Read replica workaround, corrections * PLT-7567: upgrade correction
* Simplification of a Channel Members query. (#8345)George Goldberg2018-02-281-3/+3
|
* merge 4.7.1 to masterSaturnino Abril2018-02-191-0/+12
|\
| * Add upgrade code from 4.7.0 to 4.7.1JoramWilander2018-02-161-0/+12
| |
| * Merge branch 'release-4.7' into XYZ-110Jonathan Fritz2018-02-137-72/+15
| |\
| | * revert master changesDerrick Anderson2018-02-127-72/+15
| | |
| * | Removed unused fields from ChannelMemberHistory table, introduced new ↵Jonathan Fritz2018-02-123-18/+20
| |/ | | | | | | model.ChannelMemberHistoryResult object that includes those fields that are selected from a join on other tables
* | PLT-8723: Fix DeadLock on reactions insertions (#8225)Jesús Espino2018-02-151-6/+20
| | | | | | | | | | | | * PLT-8723: Fix DeadLock on reactions insertions * Improved the HasReactions update SQL
* | XYZ-110: Cherrypicking changes from release-4.7 to master (#8254)Jonathan2018-02-133-18/+20
|/ | | | | | | | * Cherry-picking 7b2861de3a09cf00d00b0872cc537d54302c4bfa to master because enterprise/master has code in it that enterprise/release-4.7 does not, and I don't want enterprise/master to break the next time somebody merges enterprise/release-4.7 to enterprise/master * Renamed file to match existing scheme (cherry picked from commit 8c22c5c6c6f835a6e73faf19036bad2a51bb9127)
* ABC-228 Update GetPosts caching to work for non-60 limits (#8233)Joram Wilander2018-02-092-7/+31
| | | | | | | | * Update GetPosts caching to work for non-60 limits * Only cache on limits of 30/60 and add test * Add comments clarifying 30 and 60 limits
* Merge branch 'release-4.7'Derrick Anderson2018-02-092-1/+2
|\
| * Increase OAuth2 state parameter limitJoramWilander2018-02-072-1/+2
| |
* | Add prepatory code for 4.8.0 (#8226)Derrick Anderson2018-02-081-0/+9
| | | | | | | | | | | | | | | | * Add prepatory code for 4.8.0 * formatting issue * build bug
* | XYZ-35: Added Support for GlobalRelay Compliance Export FormatJonathan2018-02-074-8/+32
|/ | | | | | | | | * Added username to ChannelMemberHistory struct in anticipation of supporting GlobalRelay in Compliance Export * Removed translation from debug output - this makes it complicated to use utils functions from tests in the enterprise repo * Added an advanced email function that allows for greater control over message details. Updated MessageExport config to support GlobalRelay. Added attachment support to InBucket unit tests * Moving templates in from enterprise to solve test issues * Added export format to diagnostics * Changed email attachment code to use FileBackend so that S3 storage is properly supported
* Uncomment upgrade code for 4.7 (#8201)Joram Wilander2018-02-051-4/+4
|
* make channel autocomplete sort case-insensitive (#8176)Chris2018-01-311-1/+1
|
* ABC-79: Optimize channel autocomplete query (#8163)Chris2018-01-315-163/+231
| | | | | | * optimize channel autocomplete query * move to new autocomplete endpoint
* XYZ-32: Increases size of position to 128 characters. (#8148)Martin Kraft2018-01-262-6/+14
| | | | | | | | | | * XYZ-32: Changes type of 'position' column on 'users' table. * XYZ-32: Uncomment to run on CI and pre-release. * XYZ-32: Reverts translation changes. * XYZ-32: Fix for gofmt.
* Add GET /emojis/name/{emoji_name} API endpoint (#8142)Joram Wilander2018-01-241-0/+4
|
* ABC-90 Add POST /emoji/search and GET /emoji/autocomplete API endpoints (#8125)Joram Wilander2018-01-234-0/+114
| | | | | | * Add POST /emoji/search and GET /emoji/autocomplete API endpoints * Add constant to be clearer
* Add sort query parameter to GET /emojis (#8121)Joram Wilander2018-01-194-19/+38
|
* ABC-73 Move session clean-up to daily task (#8095)Joram Wilander2018-01-174-21/+87
| | | | | | * Move session clean-up to daily task * Split delete query into batches
* [PLT-7793] Add /users/tokens/search endpoint (#8088)Adrian Carolli2018-01-114-0/+80
| | | | | | | | * Add /users/tokens/search endpoint + tests * Fix check-style * Unnecessary deletion
* [PLT-7793] Added /users/tokens endpoint (#8038)Adrian Carolli2018-01-054-0/+35
| | | | | | | | | | | | | | | | | | | | | | | | | | | | * Added /users/tokens/all endpoint - UserAccessStore now has getAll method - Added tests - Added route - Added handler * Remove space fix check-style * Remove blank space check-style * Fixes for make check-style * Remove extra code that is un-needed in user_test.go * Rename endpoint + grammar - Renamed /users/tokens/all to /users/tokens - Renamed getUserAccessTokens to getUserAccessTokensForUser - Renamed getAllUserAccessTokens to getUserAccessTokens - Minor Grammar changes * Add localization for sql_user_access_token.get_all * Fix minor plural spelling
* Uncomment upgrade for 4.6 (#8045)Derrick Anderson2018-01-051-11/+5
| | | | | | * Uncomment upgrade for 4.6 * add 4.6 version
* PLT-8312: Use combined LIKE/Full Text search for channels. (#8029)George Goldberg2018-01-053-24/+140
| | | | | | | | | | * PLT-8312: Use combined LIKE/Full Text search for channels. * Code tidyup * Get it working consistently and update unit tests. * Fix code style.
* PLT-8483: Ignore join/leave team messages for unread counts (#8042)Jesús Espino2018-01-051-2/+4
|
* [PLT-8173] Strip the post_ prefix on incoming webhook overrides. (#8019)Jesse Hallam2018-01-031-2/+6
|
* [PLT-8173] Add username and profile picture to webhook set up pages (#8002)Jesse Hallam2018-01-021-0/+3
|
* Reduce logging data races, fix MySQL test race condition (#7994)Chris2017-12-221-1/+2
| | | | | | | | * fix races * revert unintentional change * fix test as intended
* PLT-8354: Fix user search error when terms end up as empty space. (#7984)George Goldberg2017-12-202-1/+7
|
* fix posts created at test (#7977)Chris2017-12-142-12/+7
|
* PLT-8297: Message Export Should Still Produce Valid Exports if ↵Jonathan2017-12-122-23/+191
| | | | | | | | | | | | | | | | | | ChannelMemberHistory Data is Missing (#7951) * Added a less accurate ChannelMembers fallback that is used if export period occurs before MessageExport was enabled * Fixed test names * Improved testing * Made hasDataFromBefore() a little less strict * Fixed the test to cleanly truncate the ChannelMemberHistory table without exposing the db via the interface * Renamed a function for better clarity * Binary logic is hard
* Fixing formating on SQL errors for get parent posts. (#7965)Christopher Speller2017-12-121-1/+1
|
* Add upgrade code for 4.6Christopher Speller2017-12-081-0/+10
|
* Uncomment upgrae for 4.5Christopher Speller2017-12-081-8/+2
|
* Hash key for plugin store and limit id length (#7933)Joram Wilander2017-12-052-2/+6
|
* PLT-8233: Purge ChannelMemberHistory Data when Data Retention Job runs (#7937)Jonathan2017-12-054-22/+46
| | | | | | | | | | * Changed the channel member history purge function to match pattern established by other data retention purge methods * Simplifying the channel member history store and associated tests * Regenerating mocks * Using a constant
* Revert "Hash key for plugin store table and limit plugin ID length (#7915)" ↵Christopher Speller2017-12-012-6/+2
| | | | | (#7931) This reverts commit c3af8785734803b6199a28249537ef3e47fe4caa.