video appears more pixelated in jami-qt compared to jami-gnome

Describe your environment

Please specify the following:

• OS: Guix System
• Jami version: 20210326.1.cfba013
• What build you are using: The one in Guix (guix install jami-qt)

Steps to reproduce

• Can you reproduce the bug: at will
• Steps:
  1. Start jami-qt 2. Join a video conference (rendezvous point)
• Actual result: The video is pixelated; most noticeable for text characters:
• Expected result: It should be as good as the output of jami-gnome; here's a screenshot from jami-gnome for comparison:

changed title from video is more pixelized in jami-qt compared to jami-gnome to video is more pixelated in jami-qt compared to jami-gnome

changed title from video is more pixelated in jami-qt compared to jami-gnome to video appears more pixelated in jami-qt compared to jami-gnome

changed milestone to %Backlog

assigned to @mzhang

removed milestone %Backlog

I did a few tests: Windows 10, Jami (newest Version of Jami) The video appears even more pixelated if you share your screen and scroll down a web page or if you move around in a video game. Any (fast) movement leads to a pixelated video. Even if you have a good Internet connection.

same if you use a virtual webcam: OBS-VirtualCam

Should improve https://review.jami.net/c/jami-client-qt/+/17816

mentioned in commit b420ca3a

using Jami (Windows 10, newest update): the issue still persists AND it's even worse than before. massive lag (good Internet connection)

Can you show me any video frame that you have that contains text?

Technically, the performance will drop since we want to avoid pixelated frames, do you have any profiler that can compare the resource usages?

For me, the increase is acceptable.

It would be great if you do tests with video games: 2 ways: Use Jami to share your screen OR use OBS-VirtualCam

for example Crysis PC, gta 5 etc.; using windows 10 pc (resolution HD) and your friend uses windows 10 pc (resolution Full-HD) OR a different operating system (Android (Smartphone, Tablet) etc. to see you playing.

so different resolutions and other internet connection

I am using Jami 202104301641 (windows 10). Does this version / update contain the video improvement?

Yes, it should contain it,

and sorry that we cannot test it with games for now, but will look into that when this is prioritized

added SprintDone label

Still same problem (as mentioned: especially if you scroll down a web page) ScreenshareFail2

Device 1: Windows 10; Device 2 (Receiver): Android

if you move around in a video game: ScreenshareFail

lag, #375 (closed)

Thanks for these, we will check on that

removed SprintDone label

added SprintDone label

@mzhang stil lthe case?

I would say no, but as @El4 posted, some issues on his side,

I think we can keep this for now

Just tried it again: slow internet connection (PC; smartphone fast; different network used): steady pictures are pixelated; any fast movement: even worse

fast internet connection (even using hotspot of smartphone): steady pictures are less pixelated ... BUT any fast movement leads to a pixelated video

See "ScreenshareFail2" and "ScreenshareFail". video lag in both cases #375 (closed)

I did a few test (newest version of Jami, using Windows 10):

If you only share a specific small section of your screen the video does NOT appears more pixelated. Even if you quickly scroll up and down on a web page. (see example)

However - as soon as I share a larger section of the screen or the entire screen the video video appears more pixelated - even if you don't scroll up or down.

small section of screen: no problem

larger section of the screen or the entire screen: video pixelated

good internet speed: video is still more pixelated if you quickly scroll up and down on a web page

hardware acceleration off didn't help.

similar issue using android: (Android: Screen share, Windows 10: user sees phone screen)

here is what you see (Windows 10):

(Note that you don't have any issues if look at the display of the smartphone: smartphone has good internet speed )

FailAndroid

changing video codec didn't help. However using some video codecs (VP8,MP4-ES and H263-1998) can't be used to share your screen (just black screen or Jami freezes)

Android (Jami): If you ENABLE hardware-accelerated video encoding you have LESS video lag and hardly any pixelated video (newest Jami beta).

mentioned in issue #541 (closed)

mentioned in issue jami-client-android#1017 (closed)

mentioned in issue #514 (closed)

mentioned in issue #624

mentioned in issue #698 (closed)

mentioned in issue jami-client-android#1212

mentioned in issue jami-client-android#1355