Beginners Guide To Ripping With Gordian Knot

elchupacabra

Awesome results.

elguaxo wrote:

when the amount of blocks is too high it fails, but if you want to get those few very blocky frames you'll kill all the details of the good frames

That needn't happen. You can split the video into ranges (frame start/end numbers) according to the level of blocking: low, medium and high blocking and then use the appropriate filter settings. This is what I usually do for the denoising too. I never apply the same filters for the entire movie. :wink:

elguaxo

heh, the very blocky frames are really just single frames here and there. Splitting would mean hundreds of "1 frame" ranges. If you do it, don't forget to include a PayPal link with your release. :wink:

Slayer

elguaxo wrote:

Script:

Code:

Import("D:\AviSynth 2.5\plugins\DeBlock_QED_MT2.avs")

DGDecode_mpeg2source("H:\videos\samples\slayer\SampleWarrior.d2v")

deblock_qed( quant1=0,quant2=45)

crop( 0, 0, -2, -4)
Spline36Resize(720,400)

dfttest(tbsize=3,tosize=1)

Wow, thanks! About this script: DGDecode is placed under # SOURCE? And dfttest is placed between resizing and denoising? And where should I extract the dft zipfile? In the plugins folder?

Thanks again! :beerchug:

Slayer

spudthedestroyer

yes, yes, errr yes

elguaxo

Err... search...

Where to get what you need?

http://avisynth.org/mediawiki/Main_Page
http://forum.doom9.org/
http://avisynth.org/warpenterprises/ (usually outdated)

I'm a good boy and will search the links for you this time:

DeBlock_QED_MT2.avs needs the AVS file linked above and:
DeBlock: http://avisynth.org/warpenterprises/fil ... 060214.zip (you need just the DLL)
DCTFilter: http://avisynth.org/warpenterprises/fil ... 030221.zip (you need just the DLL)
MaskTools: http://manao4.free.fr/masktools-v2.0a35.zip (you need only mt_masktools-25.dll)

dfttest: read the first post of the doom9 thread I linked:

Terranigma wrote:

dfttest by tritical

Info:
2D/3D frequency domain denoiser.

Requires libfftw3f-3.dll to be in the search path.
http://www.fftw.org/install/windows.html

Download

so... you need libfftw3f-3.dll in the search path and dfttest.dll

libfftw3f-3.dll should not be loaded or imported, copy it for example into your windows/system32 folder. The rest of the DLLs need to be loaded via LoadPlugin in your AVS script.

Slayer

Thanks for being a good boy

I was not asking for download links, only for confirmation of what I posted about the script was correct. As I'm usually not fiddling around so much with scripts, I don't know much about them, so what for you and other people might seem very logical, is abracadabra to me.

Thanks for explaining so clearly :beerchug:

I'm gonna try out tonight.

BadBugs

24 pages now to search through for filtering help... could someone start a filtering guide so that its all compacted in a much easier to find page?

I personally can't even remember what filters I've used or how they worked (did I ever know how they worked?) as its been a long time since I ripped anything & personally I've only got an hour a night to sit in this chair & I'm sure that I'm not the only person in this situation.

Thanks to whoever does it :thumbsup:

@elguaxo:

Is this: viewtopic.php?p=191912#p191912 an upgrade to the deblock filtering you gave me for KFVK?

elguaxo

This is a slow script, but faster than the other solution I gave you that time. The script I gave you included Motion compensated denoising, this one is doing only spatial/temporal denoising via Dfttest. IMO motion compensated denoising/sharpening is still the way to go for extreme results, but sometimes it's an overkill.

elchupacabra

A list of filters and a short hint on when they should be used would be great. How can I help? :wink:

elguaxo

Well... I'm still working on a guide. To keep it simple, but useful I'll describe only 5 filters:

degrainmedian
fft3dfilter
MVTools/MVDegrain1/2/3
TDeint/TIVTC
LimitedSharpen

maybe also Dehalo_alpha and MRestore too, but that's it.

Slayer

OK, I tried and I got a 190 MB file instead of a 1.45 GB

Comptest was 82.5% and I was using heini_mr filter.

The log:

Code:

12-9-2008 21:59:08: Job " 1 - VTS_02_1.avi" started.
 
o  Xvid - First Pass:         C:\Rip\VTS_02_1.avs
o  Xvid - Second Pass:        C:\Rip\VTS_02_1.avs
o  Mux Audio.
End of Job 1 ( 1 - VTS_02_1.avi).
______________________________________________________________
Gordian Knot 
Encoding Job Data:
 
Type:               EncXvid_All
Container:          Audio-Video Interleave (AVI)
Number:             1
Name:                1 - VTS_02_1.avi
Platform:           WinXP (5.1.2600).2

Files:
VirtualDubModExe:   C:\PROGRA~1\GORDIA~1\VirtualDubMod\VirtualDubMod.exe
NandubExe:          C:\PROGRA~1\GORDIA~1\nandub\Nandub.exe
AviFinal:           C:\Rip\VTS_02_1.avi
AviMovie:           C:\Rip\VTS_02_1_Movie.avi
AviCredits:         C:\Rip\VTS_02_1_Credits.avi
MovieFS:            C:\Rip\VTS_02_1.avs
CreditsFS:          
Log :               C:\Rip\VTS_02_1.log
Stats:              C:\Rip\VTS_02_1.stats
Ecf :               C:\Rip\VTS_02_1.ecf

Options:
Quality/DRF:        0
CreditsStart:       0
UseEcf:             1
CreditsIVTC:        0
CreditsAppend:      0
DeleteInterm.:      0
EnforceBitrate:     0
AntiShit:           0

Calculator:
VideoSize:          1386377 kbyte.
Audio1Size:         130759 kbyte.
Audio2Size:         0 kbyte.
Overhead:           6574 kbyte.
AviSize:            1523712 kbyte (1488 mbyte).
FilesSize:          0 kbyte.
TotalSize:          1523712 kbyte (1488 mbyte).
Interleaving:       ac3
Bitrate:            2036 k(=1000)Bits/s
Frames:             139476
FPS:                25.000
Duration:           132:59
Quality:            0.301 bits/(pixel*frame).
CompCheck3:         0.000 bits/(pixel*frame).
CompCheck5:         0.365 bits/(pixel*frame).
Resolution:         704 x 384

Audio 1:            
Mode:               Just Mux Source File.
SourceFile:         C:\Rip\VTS_02_1 T01 2_0ch 192Kbps DELAY 0ms.ac3
WavFile:            C:\Rip\VTS_02_1 T01 2_0ch 192Kbps DELAY 0ms.wav
Mp3File:            C:\Rip\VTS_02_1 T01 2_0ch 192Kbps DELAY 0ms.mp3
OggFile:            C:\Rip\VTS_02_1 T01 2_0ch 192Kbps DELAY 0ms.ogg
OggQuality:         0.200
OggLanguage:        English
Azid:               
Lame:               
Delay:              0
Interval:           1
Preload:            500
Mux:                1
Recalc:             1
DeleteWav:          1

Audio 2:            
none.               
 
21:59:08: Audio 1, determined:     130759 kb
21:59:08: Audio 1, calc:           130759 kb
21:59:08: New Bitrate for Movie = 2036 k(=1000)Bits/s

Adding this script to C:\PROGRA~1\GORDIA~1\VirtualDubMod\LastJob.vcf :

// $job "XviD First Pass"
// $input "C:\Rip\VTS_02_1.avs"
// $output "C:\Rip\VTS_02_1_Movie.avi"
// $state 0
// $start_time 0 0
// $end_time 0 0
// $script

VirtualDub.Open("C:\\Rip\\VTS_02_1.avs",0,0);
VirtualDub.video.SetDepth(24,24);
VirtualDub.video.SetMode(1);
VirtualDub.video.SetFrameRate(0,1);
VirtualDub.video.SetIVTC(0,0,-1,0);
VirtualDub.video.SetRange(0,0);
VirtualDub.video.SetCompression(0x64697678,0,10000,0);
VirtualDub.video.SetCompData(3012,"AQAAALwCAACQsggAQzpcUmlwXFZUU18wMl8xLn
N0YXRzADAAMgBfADEALgBzAHQAYQB0AHMAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
(a lot of A's and some other letters)AAAA");
VirtualDub.video.filters.Clear();
VirtualDub.subset.Delete();
VirtualDub.SaveAVI("C:\\Rip\\VTS_02_1_Movie.avi");
VirtualDub.Close();

// $endjob
//
//--------------------------------------------------
// $done

21:59:08: Started   Xvid - First Pass: C:\Rip\VTS_02_1.avs
22:17:53: Finished  Xvid - First Pass: Duration: 18 minutes, 45 seconds.
22:17:53: Trying to open Log-file.
22:17:53: Success: Log-file open.
22:17:53: Encoded:  6986 Frames.
22:17:53: Speed:    6.206 Frames per Second.
22:17:53: WARNING: Number of counted frames differs from settings!
22:17:53: WARNING: Settings:      139476
22:17:53: WARNING: Counted:       6986
22:17:53: WARNING: Difference:    132490
22:17:53: Correcting Bitrate...
22:17:53: Original Bitrate = 2036 k(=1000)Bits/s
22:17:53: Error: Correction impossible.
22:17:53: Now encoding at 2036 k(=1000)Bits/s
22:17:53: New target size =    1386378 Kb

Adding this script to C:\PROGRA~1\GORDIA~1\VirtualDubMod\LastJob.vcf :

// $job "XviD Second Pass"
// $input "C:\Rip\VTS_02_1.avs"
// $output "C:\Rip\VTS_02_1_Movie.avi"
// $state 0
// $start_time 0 0
// $end_time 0 0
// $script

VirtualDub.Open("C:\\Rip\\VTS_02_1.avs",0,0);
VirtualDub.video.SetDepth(24,24);
VirtualDub.video.SetMode(1);
VirtualDub.video.SetFrameRate(0,1);
VirtualDub.video.SetIVTC(0,0,-1,0);
VirtualDub.video.SetRange(0,0);
VirtualDub.video.SetCompression(0x64697678,0,10000,0);
VirtualDub.video.SetCompData(3012,"AgAAALwCAACKJxUAQzpcUmlwXFZUU18wMl8x
LnN0YXRzADAAMgBfADEALgBzAHQAYQB0AHMAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
AAAAAAAA(a lot of A's and some other letters)AAAAAAAA");
VirtualDub.video.filters.Clear();
VirtualDub.subset.Delete();
VirtualDub.SaveAVI("C:\\Rip\\VTS_02_1_Movie.avi");
VirtualDub.Close();

// $endjob
//
//--------------------------------------------------
// $done

22:17:54: Started   Xvid - Second Pass: C:\Rip\VTS_02_1.avs
22:36:43: Finished  Xvid - Second Pass: Duration: 18 minutes, 49 seconds.
22:36:43: Speed:    6.183 Frames per Second.

Adding this script to C:\PROGRA~1\GORDIA~1\VirtualDubMod\LastJob.vcf :

// $job "DivX5 Append"
// $input "C:\Rip\VTS_02_1_Movie.avi"
// $output "C:\Rip\VTS_02_1.avi"
// $state 0
// $start_time 0 0
// $end_time 0 0
// $script

VirtualDub.Open("C:\\Rip\\VTS_02_1_Movie.avi",0,0);
VirtualDub.RemoveInputStreams();
VirtualDub.stream[0].SetSource("C:\\Rip\\VTS_02_1 T01 2_0ch 192Kbps DELAY 0ms.ac3",0x00000203,0);
VirtualDub.stream[0].SetMode(0);
VirtualDub.stream[0].SetInterleave(1,500,1,0,0);
VirtualDub.stream[0].SetClipMode(1,1);
VirtualDub.stream[0].SetConversion(0,0,0,0,0);
VirtualDub.stream[0].SetVolume();
VirtualDub.stream[0].SetCompression();
VirtualDub.video.SetDepth(24,24);
VirtualDub.video.SetMode(0);
VirtualDub.video.SetFrameRate(0,1);
VirtualDub.video.SetIVTC(0,0,-1,0);
VirtualDub.video.SetRange(0,0);
VirtualDub.video.SetCompression();
VirtualDub.video.filters.Clear();
VirtualDub.subset.Delete();
VirtualDub.SaveAVI("C:\\Rip\\VTS_02_1.avi");
VirtualDub.Close();

// $endjob
//
//--------------------------------------------------
// $done

22:36:43: Started   Muxing Audio.: C:\Rip\VTS_02_1_Movie.avi
22:36:51: Finished  Muxing Audio.: Duration: 7 seconds.

22:36:51: Done.
22:36:51: Movie = C:\Rip\VTS_02_1.avi
Total Encoding Time: 37 minutes, 42 seconds.
12-9-2008 22:36:51: Job " 1 - VTS_02_1.avi" finished.
_______________________________________________________

and the avs script:

Code:

# Created with Gordian Knot
#
# http://gknot.doom9.org

#  PLUGINS
LoadPlugin("C:\PROGRA~1\GORDIA~1\DGMPGDec\DGDecode.dll")
LoadPlugin("C:\PROGRA~1\GORDIA~1\AviSynthPlugins\decomb.dll")
#LoadPlugin("C:\PROGRA~1\GORDIA~1\AviSynthPlugins\KernelDeInt.dll")
#LoadPlugin("C:\PROGRA~1\GORDIA~1\AviSynthPlugins\UnDot.dll")
#LoadPlugin("C:\PROGRA~1\GORDIA~1\AviSynthPlugins\dgbob.dll")
#LoadPlugin("C:\PROGRA~1\GORDIA~1\AviSynthPlugins\Convolution3d.dll")
#LoadPlugin("C:\PROGRA~1\GORDIA~1\AviSynthPlugins\FluxSmooth.dll")
#LoadPlugin("C:\PROGRA~1\GORDIA~1\AviSynthPlugins\TomsMoComp.dll")
#LoadPlugin("C:\PROGRA~1\GORDIA~1\AviSynthPlugins\VSFilter.dll")
#LoadPlugin("C:\PROGRA~1\GORDIA~1\AviSynthPlugins\SimpleResize.dll")
LoadPlugin("C:\PROGRA~1\GORDIA~1\AviSynthPlugins\RemoveGrain.dll")
LoadPlugin("C:\PROGRA~1\GORDIA~1\AviSynthPlugins\mvtools.dll")
LoadPlugin("C:\PROGRA~1\GORDIA~1\AviSynthPlugins\MaskTools.dll")
LoadPlugin("C:\PROGRA~1\GORDIA~1\AviSynthPlugins\degrainmedian.dll")
LoadPlugin("C:\PROGRA~1\GORDIA~1\AviSynthPlugins\deblock.dll")
LoadPlugin("C:\PROGRA~1\GORDIA~1\AviSynthPlugins\DctFilter.dll")
LoadPlugin("C:\PROGRA~1\GORDIA~1\AviSynthPlugins\dfttest.dll")
LoadPlugin("C:\PROGRA~1\GORDIA~1\AviSynthPlugins\mt_masktools-25.dll") 
Import("C:\Program Files\AviSynth 2.5\plugins\DeBlock_QED_MT2.avs")

#  SOURCE
mpeg2source("C:\Rip\VTS_02_1.d2v")

#  TRIM
#trim(startframe,endframe)

#  IVTC
#Telecide(order=1,guide=1).Decimate()
#  or use
#IVTC(44,11,95)
#GreedyHMA(1,0,4,0,0,0,0,0)

#  DEINTERLACING (1)
#FieldDeinterlace()
FieldDeinterlace(blend=false)
#TomsMoComp(1,5,1)

#  DEINTERLACING (2)
#KernelDeInt(order=1,sharp=true)
#  or maybe
#DGBob(order=1,mode=0)

#  DEINTERLACING (3) - special requests
#GreedyHMA(1,0,0,0,0,0,0,0)
#Telecide()
#SeparateFields()

deblock_qed( quant1=0,quant2=45)

#  CROPPING
crop(0,0,716,572)

#  SUBTITLES
#VobSub("FileName")

#  RESIZING
Spline36Resize(704,384)

dfttest(tbsize=3,tosize=1)

#  DENOISING: choose one combination (or none)
DeGrainMedian(limitY=2,limitUV=3,mode=1)

#  1) little noise
#Temporalsoften(2,3,3,mode=2,scenechange=6)
#mergechroma(blur(1.3))
#FluxSmoothST(5,7)

#  2) medium noise
#Temporalsoften(3,5,5,mode=2,scenechange=10)
#Convolution3d("moviehq") 
#FluxSmoothST(7,7)

#  3) heavy noise
#Temporalsoften(4,8,8,mode=2,scenechange=10)
#Convolution3d("movielq") 
#FluxSmoothST(10,15)

#  BORDERS
#AddBorders(left,top,right,bottom)

#  COMPRESSIBILITY CHECK
#  !!!!Snip Size now has to be 14 for use in GKnot!
SelectRangeEvery(280,14)

#  FOOL CCEnc
#empty = BlankClip()
#AudioDub(last,empty)

elguaxo

he, delete this line:

Code:

SelectRangeEvery(280,14)

Slayer

Will do

elchupacabra

Does anybody know anything about filtering audio? In the movie I'm ripping currently there is a scene in which people talk inside a car, but it sounds like they are inside a metal box.

It's only 10 seconds but I would like to fix this somehow.

BadBugs

elguaxo wrote:

Well... I'm still working on a guide. To keep it simple, but useful I'll describe only 5 filters:

degrainmedian
fft3dfilter
MVTools/MVDegrain1/2/3
TDeint/TIVTC
LimitedSharpen

maybe also Dehalo_alpha and MRestore too, but that's it.

Sounds good elguaxo. I look forward to that.
Just a thought though, could you explain it in a patronising way so that those amongst us who have no idea what temperal noise or subspace quantifiers or the majority of the technobabble terms mean, can instantly learn from you please?
I've tried to understand the wiki page & most of the time the explanations are worded in such a way that unless you already know what they mean then you are still going to be clueless afterwards.
Thanks & good luck :beerchug:

elchupacabra wrote:

A list of filters and a short hint on when they should be used would be great. How can I help? :wink:

I'm sure that you could work alongside elguaxo explaining the filters that he's not going to put in his guide.

Maybe a summary of what you need to look for in your rip & then a filter for fixing it?
eg. pixellation, noise, interlacing, over/undersharp, halo, rainbows, softness, blended frames etc.

I hope you guys can do this between you & I'm looking forward to the guide :thumbsup:

RedVeil

If you open the "video filter" dialog in AviDemux you have almost the same filters like in GKnot and each is briefly explained. You can apply them by setting parameter values through GUIs. It's very comfortable.

elchupacabra

BadBugs wrote:

I'm sure that you could work alongside elguaxo explaining the filters that he's not going to put in his guide.

I personally think that a filter doesn't have to be explained in detail. Every filter should come with a HTML help file that explains all parameters.

What would be better is to explain what filters are available for what. Because finding the right filter is the real difficult part imho.

Slayer

elguaxo wrote:

he, delete this line:

Code:

SelectRangeEvery(280,14)

Comptest now gave me 188.5%, which seems a little too much for me :wacky:

Different filter, maybe?

spudthedestroyer

Slayer wrote:

elguaxo wrote:

he, delete this line:

Code:

SelectRangeEvery(280,14)

Comptest now gave me 188.5%, which seems a little too much for me :wacky:

Different filter, maybe?

erm, i thought you were talking about your full encode being undersized? Well that line is JUST for the comp test, it selects a small range of the movie and encodes it.

The comp test is pretty much worthless

Beginners Guide To Ripping With Gordian Knot

Who is online