Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Client is not able to generate dynamic thumbnail as Element can #3665

Closed
itsthejb opened this issue Jan 7, 2025 · 1 comment
Closed

Client is not able to generate dynamic thumbnail as Element can #3665

itsthejb opened this issue Jan 7, 2025 · 1 comment
Labels

Comments

@itsthejb
Copy link

itsthejb commented Jan 7, 2025

Steps to reproduce

  1. Setup mautrix/whatsapp bridge and test sending videos using the WhatsApp client itself or via the bridge
  2. The message payloads are quite different in the two cases (see below and linked issue)
  3. Observe thumbnails in the client vs. original Element client

Outcome

What did you expect?

In spite of lack of thumbnail payload, client generates dynamic thumbnail as Element does

What happened instead?

Element-X does not generate dynamic video thumbnails

Context: message payloads

Provided in Mautrix bridge issue:

Bridged through Element-X iOS:

{
  "type": "m.room.message",
  "sender": "@<>:<redacted>",
  "content": {
    "msgtype": "m.video",
    "body": "<redacted> ",
    "format": "org.matrix.custom.html",
    "formatted_body": "<redacted>",
    "filename": "94B6E60C-45D6-4114-A1D5-342841CE349B.mp4",
    "url": "mxc://<redacted>/REsrKiRAiCuRbrfTLkSUFIrS",
    "info": {
      "duration": 26370,
      "h": 720,
      "w": 1280,
      "mimetype": "video/mp4",
      "size": 34728286,
      "thumbnail_info": {
        "h": 450,
        "w": 800,
        "mimetype": "image/jpeg",
        "size": 135285
      },
      "thumbnail_url": "mxc://<redacted>/EFOWLRrwsLtYTYIHTmYBpGnq",
      "xyz.amorgan.blurhash": "KQGu?lIoM|?KWBM{.7R%t6"
    }
  },
  "origin_server_ts": 1736240406650,
  "unsigned": {
    "membership": "join",
    "age": 2877522
  },
  "event_id": "$3A9vmWM6AxnqSL9HYqDycpmPpBbrQ1f1wKbZ-iyLLA4",
  "room_id": "!vvAqySpsGiHYNgxulG:<redacted>"
}

And the second sent directly using WhatsApp iOS and then bridged via Mautrix-WhatsApp only:

{
  "type": "m.room.message",
  "sender": "@jc:<redacted>",
  "content": {
    "msgtype": "m.video",
    "body": "<redacted>",
    "filename": "video.mp4",
    "url": "mxc://<redacted>/OHpDpeKcjGQjhXWBuyatsoms",
    "info": {
      "duration": 49000,
      "h": 848,
      "w": 480,
      "mimetype": "video/mp4",
      "size": 8952788
    }
  },
  "origin_server_ts": 1736240524742,
  "unsigned": {
    "membership": "join",
    "age": 2759430
  },
  "event_id": "$08ni8pKv70YvOU4FuFF9BA1gGQKKn1FsnxUIYKpVx9c",
  "room_id": "!vvAqySpsGiHYNgxulG:<redacted>"
}

Your phone model

iPhone 15

Operating system version

18.2

Application version

1.9.10

Homeserver

Synapse 1.120.0

Will you send logs?

No

@pixlwave
Copy link
Member

pixlwave commented Jan 7, 2025

Hey thanks for opening the issue, but given that we're running on a mobile device we're not going to commit to downloading entire videos just to extract a thumbnail from them as we have to consider the cellular connection (both from a bandwidth and data restrictions perspective). Whilst I appreciate that the bridge issue has been open for a few years, this is definitely something that should be fixed on their side.

@pixlwave pixlwave closed this as not planned Won't fix, can't repro, duplicate, stale Jan 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants