Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove meilisync as an option to sync PostgreSQL #2960

Open
omar-zahid opened this issue Aug 25, 2024 · 6 comments
Open

Remove meilisync as an option to sync PostgreSQL #2960

omar-zahid opened this issue Aug 25, 2024 · 6 comments

Comments

@omar-zahid
Copy link

omar-zahid commented Aug 25, 2024

meilisync is suggested as a way to sync data between Postgresql and meilisearch. This wrongly implies meilisync as an official adapter from meilisearch. To make things worse, this app is buggy (at least for PG) and causes errors in production.

Here is the documentation in question: https://www.meilisearch.com/docs/guides/database/meilisync_postgresql

Here are the open issues in meilisync related to postgres.

long2ice/meilisync#68
long2ice/meilisync#111
long2ice/meilisync#37
long2ice/meilisync#28

For us, we've encountered production outage due to WAL errors and our storage spiked to 100% due to the replication slot errors.

image

Please consider removing meilisync from the documentation at least until the issues above are addressed and the app is stable. Thank you.

@omar-zahid omar-zahid changed the title Remove meilisync as an option to stream PostgresQL Remove meilisync as an option to sync PostgresQL Aug 25, 2024
@omar-zahid omar-zahid changed the title Remove meilisync as an option to sync PostgresQL Remove meilisync as an option to sync PostgreSQL Aug 25, 2024
@guimachiavelli
Copy link
Member

guimachiavelli commented Sep 4, 2024

Thanks for the feedback, @omar-zahid. We have been getting more and more reports of users experiencing similar issues. We were already seriously considering removing meilisync content from the docs and your report sort of seals the deal for me.

@Strift, I think we should go ahead and remove both the Postgre and the MySQL meilisync guides. I know we don't have a suitable alternative, but at this point I think it's best to have nothing than something that actively harms users. Are you ok with that?

@Strift
Copy link
Contributor

Strift commented Sep 10, 2024

@guimachiavelli, I agree.

But these guides are also featured in Meilisearch Cloud, so we need to validate this with @meilisearch/product-team.

@macraig
Copy link
Contributor

macraig commented Sep 10, 2024

I think this makes sense, @gmourier do you agree? If so we can ask the Cloud team to remove any mentions on the Cloud

@Strift
Copy link
Contributor

Strift commented Sep 11, 2024

Note: we have external articles linking to our meilisync guides, e.g. this piece. We'll need to think of a redirection for this links.

I think redirecting to meilisync repo would be good enough, and better than a 404. Not feeling strongly this either, so happy to go in another direction.

@gmourier
Copy link
Member

I think redirecting to meilisync repo would be good enough, and better than a 404

Agree

@Strift
Copy link
Contributor

Strift commented Sep 12, 2024

Hi @meilisearch/product-team @guimachiavelli,

Looks like @mdubus already removed this from the Cloud in August: https://github.com/meilisearch/meilisearch-cloud/issues/5082

We should be free to proceed :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants