summaryrefslogtreecommitdiffstats
path: root/app/import.go
Commit message (Collapse)AuthorAgeFilesLines
* MM-11572: Force correct order on messages generated in the bulk (#9244)Jesús Espino2018-08-241-0/+15
|
* Split app/import.go in multiple files (#9179)Jesús Espino2018-08-011-2023/+0
|
* Pr 9039 (#9187)Martin Kraft2018-07-301-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * MM-11065: Allow to search and get archived channels from the API * Fixing more tests * Add some unit tests * Add includeDeleted parameter to session permissions check function * More test fixing * Adding archive channels list in channels search * Add restriction for archived channel edition * Reverting permissions checks modification * Changed the query parameter to include_deleted * Enable search archive channels as true by default * Adding tests for verify search on deleted channels * Allowing to override archive channels during the imports * Fixed test * Search in archive channels from the API must be explicitly requested * Removing includeDeleted parameter from GetChannelByName and GetChannelByNameForTeam * Back to ViewArchivedChannels config * Fixing tests * Reverting GetChannelByName parameter * Add include deleted parameter on GetChannel functions in plugins api * Fixing tests
* Support attachments in post and replies - Bulk import (#9124)Pradeep Murugesan2018-07-201-8/+78
| | | | | | | | | | * 9006 - process the attachments of the post * 9006 enabling the import of attachments in the reply post * 9006 assert if the post and files are linked * 9006 fixed the typo
* Avoid using app function so bulk loading does not fail when custom emojis ↵Joram Wilander2018-07-121-6/+6
| | | | are disabled (#9064)
* Add ability to bulk import emoji (#9048)Joram Wilander2018-07-051-0/+77
| | | | | | | | * Add ability to bulk import emoji * Improve error handling * Update test config
* Make import compatible with scheme-roles. (#9028)George Goldberg2018-06-291-6/+42
| | | | | This doesn't introduce new fields as we would then break backwards compatability with old "roles" fields. We can add custom fields if/when we go to "version 2" of the bulk import format.
* Add english missed texts to i18n/en.json (#8987)Jesús Espino2018-06-281-1/+1
| | | | | * Add English missed texts to i18n/en.json * Update en.json
* Lock bulk importing to master database node (#9012)Joram Wilander2018-06-271-0/+3
|
* MM-10233: Add scheme importing to bulk importer. (#8928)George Goldberg2018-06-211-1/+269
|
* MM-10791: Don't try and generate thumbnails for non-images/svgs. (#8937)George Goldberg2018-06-121-4/+6
|
* [MM-10645] Remove desktop duration notify props (#8851)Saturnino Abril2018-05-251-14/+2
| | | | | | | | | | * remove desktop duration notify props Signed-off-by: Saturnino Abril <saturnino.abril@gmail.com> * fix test Signed-off-by: Saturnino Abril <saturnino.abril@gmail.com>
* Structured logging (#8673)Christopher Speller2018-04-271-10/+9
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Implementing structured logging * Changes to en.json to allow refactor to run. * Fixing global logger * Structured logger initalization. * Add caller. * Do some log redirection. * Auto refactor * Cleaning up l4g reference and removing dependancy. * Removing junk. * Copyright headers. * Fixing tests * Revert "Changes to en.json to allow refactor to run." This reverts commit fd8249e99bcad0231e6ea65cd77c32aae9a54026. * Fixing some auto refactor strangeness and typo. * Making keys more human readable.
* Relax 4k post message limit (#8478)Jesse Hallam2018-03-261-14/+15
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * MM-9661: rename POST_MESSAGE_MAX_RUNES to \0_v1 * MM-9661: s/4000/POST_MESSAGE_MAX_RUNES_V1/ in tests * MM-9661: introduce POST_MESSAGE_MAX_RUNES_V2 * MM-9661: migrate Postgres Posts.Message column to TEXT from VARCHAR(4000) This is safe to do in a production instance since the underyling type is not changing. We explicitly don't do this automatically for MySQL, but also don't need to since the ORM would have already created a TEXT column for MySQL in that case. * MM-9661: emit MaxPostSize in client config This value remains unconfigurable at this time, but exposes the current limit to the client. The limit remains at 4k in this commit. * MM-9661: introduce and use SqlPostStore.GetMaxPostSize Enforce a byte limitation in the database, and use 1/4 of that value as the rune count limitation (assuming a worst case UTF-8 representation). * move maxPostSizeCached, lastPostsCache and lastPostTimeCache out of the global context and onto the SqlPostStore * address feedback from code review: * ensure sqlstore unit tests are actually being run * move global caches into SqlPostStore * leverage sync.Once to address a race condition * modify upgrade semantics to match new db semantics gorp's behaviour on creating columns with a maximum length on Postgres differs from MySQL: * Postgres * gorp uses TEXT for string columns without a maximum length * gorp uses VARCHAR(N) for string columns with a maximum length of N * MySQL * gorp uses TEXT for string columns with a maximum length >= 256 * gorp uses VARCHAR(N) for string columns with a maximum length of N * gorp defaults to a maximum length of 255, implying VARCHAR(255) So the Message column has been TEXT on MySQL but VARCHAR(4000) on Postgres. With the new, longer limits of 65535, and without changes to gorp, the expected behaviour is TEXT on MySQL and VARCHAR(65535) on Postgres. This commit makes the upgrade semantics match the new database semantics. Ideally, we'd revisit the gorp behaviour at a later time. * allow TestMaxPostSize test cases to actually run in parallel * default maxPostSizeCached to POST_MESSAGE_MAX_RUNES_V1 in case the once initializer panics * fix casting error * MM-9661: skip the schema migration for Postgres It turns out resizing VARCHAR requires a rewrite in some versions of Postgres, but migrating VARCHAR to TEXT does not. Given the increasing complexity, let's defer the migration to the enduser instead.
* Improved bulkload error handling (#8491)Jesse Hallam2018-03-231-18/+18
| | | | | | | | | | | | * log the config file path used by the server on startup * return an err if the bulk import command fails * log the underlying errors that occur when importing The code assumed all errors meant a missing resource, but it's possible something else is at fault. Including the error helps pinpoint that more readily.
* XYZ-114 Adding mandatory membership to town-square in bulk-import (#8274)Jesús Espino2018-02-151-0/+6
|
* [XYZ-6] Add sampledata platform command (#8027)Jesús Espino2018-01-111-13/+223
| | | | | | | | * Add fake dependency * [XYZ-6] Add sampledata platform command * Creating EMOJI_NAME_MAX_LENGTH as a constant and using it where needed
* Role refactor (#7867)Chris2017-11-211-5/+5
| | | | | | | | * role refactor * add missing file * fix web test
* Reorganize file util functionality (#7848)Chris2017-11-161-2/+2
| | | | | | | | * reorganize file util functionality * fix api test compilation * fix rebase issue
* PLT-7978 Add websocket event for user role update (#7745)Joram Wilander2017-10-311-1/+1
| | | | | | | | * Add websocket event for user role update * Fix tests * More test fixes
* simplify things (#7735)Chris2017-10-301-1/+1
|
* refactor max channels per team enforcement (#7690)Chris2017-10-201-1/+1
|
* Reduce utils.Cfg references (#7650)Chris2017-10-181-2/+2
| | | | | | | | | | | | * app.UpdateConfig method * test fix * another test fix * the config override option as-was is just error prone, remove it for now * derp
* PLT-7883: Fix database race in bulk importer in GetByUsername. (#7611)George Goldberg2017-10-121-19/+20
|
* PLT-7789: Fix raciness on Aurora with importing team members. (#7573)George Goldberg2017-10-041-9/+5
| | | | | | * PLT-7789: Fix raciness on Aurora with importing team members. * Fix and document return values.
* Renaming repoChristopher Speller2017-09-061-3/+3
|
* app type transition (#7167)Chris2017-09-061-83/+83
|
* App: NewLocAppError -> NewAppError (#7327)George Goldberg2017-09-011-34/+34
| | | | | | * App: NewLocAppError -> NewAppError * Remove statuscode that got missed.
* PLT-???? Prepare file upload infrastructure for Data Retention. (#7266)George Goldberg2017-08-251-2/+4
| | | | | | | | | | | | | | | | | * Prepare file upload infrastructure for Data Retention. This commit prepares the file upload infrastructure for the data retention feature that is under construction. Changes are: * Move file management code to utils to allow access to it from jobs. * From now on, store all file uploads in a top level folder which is the date of the day on which they were uploaded. This commit is based on Harrison Healey's branch, but updated to work with the latest master. * Use NewAppError
* PLT-7183: User/Channel NotifyProps Bulk Import. (#7019)George Goldberg2017-07-261-0/+132
|
* PLT-7123: Add tutorial, flags and favorites to bulk importer. (#7000)George Goldberg2017-07-211-35/+146
|
* Fix some duplicate message IDs in Bulk Importer. (#6850)George Goldberg2017-07-051-2/+2
|
* PLT-6937: Bulk Importing of Direct/Group channels and posts. (#6761)George Goldberg2017-06-281-6/+234
| | | | | | * PLT-6937: Bulk Importing of Direct/Group channels and posts. * Show group/direct channels in sidebar.
* PLT-6488: Reduce database queries in user bulk import. (#6371)George Goldberg2017-05-101-26/+78
|
* Add Password field to Bulk Importer. (#6268)George Goldberg2017-04-281-1/+17
|
* Parallelise Bulk Import. (#6267)George Goldberg2017-04-281-3/+67
| | | | | | * Parallelise Bulk Import. * Set worker count through command line flag.
* PLT-5860 Updated copyright date (#6058)Harrison Healey2017-04-121-1/+1
| | | | | | | | | | | | * PLT-5860 Updated copyright date in about modal * PLT-5860 Updated copyright notice in JSX files * PLT-5860 Updated copyright notice in go files * Fixed misc copyright dates * Fixed component snapshots
* PLT-6198: Use added to channel system message on default channels. (#5969)George Goldberg2017-04-041-1/+1
| | | | Use a different sytem message when a user was added to a default channel by someone else than when they joined themselves.
* PLT-5900 Removed automatic configuration of SiteURL (#5952)Harrison Healey2017-04-041-2/+2
| | | | | | | | | | | | | | | | * Revert "PLT-5765 Passed SiteURL to SendNotifications (#5705)" This reverts commit a8e68bd8905972ae59de90fa33d5b3e3c274dc47. * Removed automatic configuration of SiteURL * Reverted unintentional config changes * Updated help text * Added link to docs in Site URL warning * Fixed merge conflict
* PLT-5800 Cleaned up duplicated code for adding slack attachments to posts ↵Harrison Healey2017-03-101-31/+2
| | | | (#5711)
* PLT-5765 Passed SiteURL to SendNotifications (#5705)Harrison Healey2017-03-101-1/+1
|
* PLT-5367: Basic post bulk importing. (#5562)George Goldberg2017-02-281-5/+120
|
* PLT-3193 Add channel notification preferences for push and email noti… (#5500)enahum2017-02-231-2/+2
| | | | | | | | | | | | | | | | * PLT-3193 Add channel notification preferences for push and email notifications * unit tests, model validation and localization * Feedback review * Adding back allowFromCache check * Setting push and email to use default settings * Move props as constants * address feedback
* PLT-5521: Mandatory version in line 1 of bulk import. (#5400)George Goldberg2017-02-161-1/+19
|
* PLT-5398 Bulk loading of user display preferences. (#5382)George Goldberg2017-02-141-0/+80
|
* PLT-5427: Import ChannelMember Notify Props. (#5329)George Goldberg2017-02-081-2/+34
|
* PLT-5407: Bulk importing of User memberships. (#5273)George Goldberg2017-02-021-0/+144
|
* PLT-5365 Import of basic user properties. (#5231)George Goldberg2017-01-311-1/+174
|
* Merge 3.6.2 into master (#5211)Joram Wilander2017-01-271-1/+1
| | | | | | | | | | * Add webhook cache * Add channel by name cache * Fxing profiles in channels cache * Fix merge
* PLT-5366, PLT-5364, PLT-5363: Bulk Import Part 1. (#5204)George Goldberg2017-01-271-1/+239
| | | | | | | This commit provides the first part of the bulk import system. The CLI command is provided, complete with validation & apply modes. All the basic properties of Teams and Channels can be imported. Users & Posts will follow separately in a future commit.
generated by cgit v1.2.3-1-g7c22 (git 2.25.1) at 2024-10-31 07:39:59 +0000