Cercare file doppioni!

**virusbye** · 14-06-2004, 13:15

Ho un grosso archivio di documenti e presumo che ci siano molti doppioni (backup della stessa roba fatti non so quante volte)... esiste un programma/script per cercare, all'interno di una directory (e tutte le sottodirectory) i file che risultano identici per dimensione e CRC?

Aspetto fiducioso

**Ikitt** · 14-06-2004, 13:27

Originariamente inviato da virusbye
Ho un grosso archivio di documenti e presumo che ci siano molti doppioni (backup della stessa roba fatti non so quante volte)... esiste un programma/script per cercare, all'interno di una directory (e tutte le sottodirectory) i file che risultano identici per dimensione e CRC?

Aspetto fiducioso

Un po` grezzo ma non mi e` venuto in mente nulla di meglio:
provalo e vedi se puo` andar bene...

codice:

find /dir/di/base/ -type f -printf "%s " -exec md5sum "{}" \;|\
sort | awk '{ printf "%s %s %s\n", $3, $2, $1 }' |\
uniq -f 1 -d

**virusbye** · 14-06-2004, 13:36

Originariamente inviato da Ikitt
Un po` grezzo ma non mi e` venuto in mente nulla di meglio:
provalo e vedi se puo` andar bene...

codice:

find /dir/di/base/ -type f -printf "%s " -exec md5sum "{}" \;|\ sort | awk '{ printf "%s %s %s\n", $3, $2, $1 }' |\ uniq -f 1 -d

ok, dopo provo!

**virusbye** · 14-06-2004, 16:39

mi da questo risultato!

[supersaibal]
/root/.aMule/shareddir.dat d41d8cd98f00b204e9800998ecf8427e 0
/root/.aMule/server.met dfd017f86bb16c9e65fa5d5390198252 10026
/root/.nautilus/metafiles/file:%2F%2F%2Ftmp%2Ffile-roller.8871.0.xml 38ec09ea6def69f96246b981c007c972 100
/root/.themes/Aqua-Meta/metacity-1/button-menu-over.png e62fc8778a9c2a689acb864c5155181f 1015
/root/.nautilus/metafiles/file:%2F%2F%2Ftmp%2Ffile-roller.11829.0%2Ftagftp.xml de600520b6ed02abd75214edd5bd3a68 102
/root/.gdesklets2/Sensors/GoodWeather/weather.com/large_icons/12.png de8dcb657e1f42dddf5807d07a25518b 10312
/root/.gdesklets2/Sensors/GoodWeather/weather.com/large_icons/18.png f88a9f7cee0e159cb47bafad6d0b48a8 10478
/root/.gdesklets2/Sensors/GoodWeather/weather.com/large_icons/1.png 8ae70880cf03662d788a38ff280c3b5a 10711
/root/.firefox/default/wc4he5i9.slt/chrome/userChrome-example.css 4788fdaa51b0a238cb21f5c2877ef06d 1078
/root/.mozilla/root/64ytwi2m.slt/Cache/7C9EC880d01 8dd9d45e3711861256d1a79984d53bea 1087075
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/20.png 2aeb699b00ba5bbddc9736334ba8bcfc 1092
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/15.png 468fffa6983914b45be6a5e828fddbc8 1118
/root/.gdesklets2/Sensors/GoodWeather/weather.com/large_icons/16.png 6d29d1a0194162e1a4dfbbb496a65948 11283
/root/.nautilus/metafiles/file:%2F%2F%2Ftmp%2Ffile-roller.2065.0.xml 7a5452e7cacac6fc900313351d3be892 114
/root/.gdesklets2/Sensors/GoodWeather/um/large_icons/7.png 363ae37f84a9976d55dcc6378daf02f9 11524
/root/.nautilus/metafiles/file:%2F%2F%2Ftmp%2Ffile-roller.2100.4.xml 4335cebe876686f1d2e0a2a7af1da935 115
/root/.nautilus/metafiles/file:%2F%2F%2Ftmp%2Ffile-roller.2100.1.xml 63d925bff2450245a3d76bdd3b3970be 115
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/22.png c79b8833b60d4a1be3ecdeeac357ae23 1185
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/9.png dda8976c99c4802f443fc92578f74d8d 1187
/root/.gdesklets2/Sensors/GoodWeather/um/large_icons/11.png b8b061aca89542145e4a8eec1a43318f 11983
/root/.gdesklets2/Sensors/GoodWeather/um/large_icons/23.png 6979f28c9888c74a5b237caf4dc54dd7 11990
/root/.thumbnails/large/74edf92dbb84bb1295457103c36fa83a.png f2b6340175d7a68920b7b421bfc67928 1206
/root/pluto 074a0711ebe9269207fb44314f69f03c 122
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/13.png f788ef7254041a06f254bcbbd21e235c 1221
/root/.gdesklets2/Sensors/GoodWeather/um/large_icons/12.png 9c6d57ac15900a116988f3fb458d26e9 12223
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/21.png 7453aa6634dbcc74c93e5db6eae35841 1249
/root/.gdesklets2/Sensors/GoodWeather/weather.com/large_icons/30.png 182a43dacb6a23052bc0d5b145a9bd83 12555
/root/.gdesklets2/Sensors/GoodWeather/um/large_icons/30.png 1514a74d214c637096cdb00a7a10b8a6 12600
/root/.gdesklets2/Sensors/GoodWeather/um/large_icons/15.png e14cb9278bb9349bb18279ca80fd9d3c 12734
/root/.gdesklets2/Sensors/GoodWeather/um/large_icons/1.png d3cc2fddcb80a88ae9c8cd7aed245722 12990
/root/.firefox/default/wc4he5i9.slt/Cache/71F65E95d01 b359b37f2aa99830f2152557d11f33ba 13007
/root/Desktop/Cpoint/head.php 08bb3f24672eaffc6106335a4e4887c1 13133
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/25.png d30708480eb299634f3a2d7b758f75f3 1369
/root/.kde/share/config/session/konqueror_10523aac64000108162600900000040000008_10 81626482_794239 c3f38dfe1d91a1364c3db2344727f330 1371
/root/.gdesklets2/Sensors/GoodWeather/um/large_icons/37.png 4cab16b2811e0014a4c3f08300bcf002 13912
/root/.gdesklets2/Sensors/IconButton/.order bce4e75f791a4d3e285bbe07120b5094 13
/root/.firefox/default/wc4he5i9.slt/Cache/453CCD3Fd01 86e98d15c4bdc381302799c1f117d2c5 14137
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/19.png 9135c02ae8dcf72a0767a3d2b2801ff2 1432
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/38.png 035c4fa37f0e7e345b55abf2239d26fd 1443
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/31.png b6be84c8b5ecc64b5dddc4e77fec06e1 1446
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/37.png e71e1a1579f6af8182e180763c4ecb23 1450
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/8.png b2252e851b96a3aa28d2dd40697733b0 1452
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/33.png 5324e724827e3b26f29c1cfad39844d2 1453
/root/.java/deployment/cache/javapi/v1.0/file/fphoverx.class-3a44756b-45c4a238.class 72fb8fdd0319893df98e1a4a1e4c8a08 1476
/root/Desktop/Cpoint/analisi.php 26342503b9d949ab4a2b4231f33b8081 1497
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/29.png 7ff69285c9128848e6f2b62d48c1d488 1514
/root/.gdesklets2/Sensors/GoodWeather/liquid/small_icons/11.png cf72f9131d38d067a87e31da33c225c0 1519
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/26.png 2444c86240f388c75d4ed16614605727 1535
/root/.gdesklets2/Sensors/GoodWeather/um/large_icons/17.png de1a359b3ad83c5aee082c7a6bb610ab 15357
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/14.png f73a762a48b5c24220029ce0803b16bb 1559
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/17.png f4f71747831ddaa2634294206cf1b008 1584
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/35.png 129779b3601121106209448abed9d5a9 1587
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/0.png 3b3129bebd9b6d6cb934384ebc69b84f 1587
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/3.png 587ea2c4242ad5b88600a49433a7b708 1589
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/4.png 128358328d8f66833f8861323fecbc58 1590
/root/.firefox/default/wc4he5i9.slt/panels.rdf f72bee301f5fa9ffc3052a48a92404b9 1607
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/10.png 7b6fc82b55d777b34009114135584011 1634
/root/.firefox/default/wc4he5i9.slt/Cache/5A75E943d01 ec8e81c432d6c157f60e9c67a773bf58 16439
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/2.png 9e399d0bab8eac255af66ac1db6e2127 1652
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/1.png 5412be018194ae1ee075fb06da63085f 1653
/root/.firefox/default/wc4he5i9.slt/Cache/48D3B0AAd01 1e401e6e344f7439f4e95caff5f2acb7 16684
/root/.gdesklets2/Sensors/GoodWeather/liquid/small_icons/12.png 4ca1e29a37ac338e00660cc6b8799902 1673
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/11.png 179b66a0cddd4c96052af0d9ae810522 1689
/root/.firefox/default/wc4he5i9.slt/Cache/AF421A86d01 bff59afc4165e12795ff26c41ca62103 16956
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/40.png 3f0f0850e35bc43e96e5f51e3c921d3f 1697
/root/.gdesklets2/Sensors/GoodWeather/liquid/small_icons/17.png dabee0aa828095472652cb03b27f6972 1701
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/6.png fad4876fbc49e6f930cbe72c8e9a77da 1716
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/18.png ba3680cf70420786120c330994c44743 1721
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/27.png f9babec18940f1700794af77388ba78d 1726
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/12.png bddf67972218bc6ad660c2d21653ee90 1727
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/5.png 34d6d838a77af87adf0f8a120c24eaf4 1728
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/39.png c127a17f081143cd1f7217a7237882fd 1728
/root/.gdesklets2/Sensors/GoodWeather/liquid/small_icons/10.png f3961473345885114c4bd756689b13c6 1733
/root/.gdesklets2/Sensors/GoodWeather/liquid/small_icons/23.png 1ba4a3aceacd61f120b2be760dcfc754 1751
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/43.png 3265cd51527a67c3fdfc35bb52a42464 1758
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/42.png 8f00f58d5a8fe374d8829d5224ca57e6 1769
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/16.png f2ecf075f873c9ff80edbda9c384b11f 1770
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/41.png fb59d57b78c5405d32d1d2b97d5bd483 1780
/root/.firefox/default/wc4he5i9.slt/Cache/D73E53CCd01 9d8eb89451302783a1c2ce2cb1de2c40 17850
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/7.png 7112e93540b6841f6fd2f16c1fb79d4c 1804
/root/.gdesklets2/Sensors/GoodWeather/liquid/small_icons/15.png 9ed38ecfbc1f850726fe93df43a7cf1d 1833
/root/.gdesklets2/Sensors/GoodWeather/liquid/small_icons/1.png 0ba6ca987b862c28d295b244cf1c129d 1842
/root/.gdesklets2/Sensors/GoodWeather/liquid/small_icons/30.png 307360e320c2988259f4c0375bd26378 1863
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/32.png e6541d111a485a99c0d564854b69eb40 1875
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/36.png 38ea641f72eb946115d1166e1196a6bd 1911
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/na.png 71541f4327e76ee0aa0e5b484d771ae3 1921
/root/.firefox/default/wc4he5i9.slt/Cache/231A2DA2d01 824ae715fa0c9c83ab128cf079b57cb6 19239
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/34.png bb3f567fb6f25474031f74def8df4fe3 1927
/root/.java/deployment/cache/javapi/v1.0/file/yavs.class-1facc84b-4b81c42c.class 8a2487ab112d49716b49c32b57ccd440 19783
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/47.png 89339ecd61882351b15fca2e21aa984b 1996
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/46.png 1317d9df3cbc17ef558bb93ffa7baf18 2016
/root/.openoffice/1.1.1/user/gallery/sg100.sdv 58b26eb6ab03be973425381f1de81aeb 2048
/root/.gdesklets2/Sensors/GoodWeather/um/small_icons/23.png 9f57c50c376930e17432edcae753ac79 2056
/root/.mozilla/root/64ytwi2m.slt/Cache/4DBECEFCd01 647a11ea402ec475e958c78b5a6a26da 20607
/root/.gdesklets2/Sensors/GoodWeather/um/small_icons/7.png 9122861e1a5e9fc1bbc5673f6dfbd8e2 2094
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/45.png 30b60f0bc26a547328a2979ce8089e4a 2096
/root/.gdesklets2/Sensors/GoodWeather/um/small_icons/11.png cb3545a3cbae8bb2bb36e499aba92e2f 2113
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/44.png 4e685e6308f3a61576f81ef445047168 2120
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/30.png 0bc50416211c27b19716be16a197f6e0 2122
/root/.gdesklets2/Sensors/GoodWeather/um/small_icons/12.png 1af113a9f3030a5c0f3c542939b17d41 2122
/root/.firefox/default/wc4he5i9.slt/Cache/A3AAF0F4d01 0912e33045f53453331755ea258de1b5 21377
/root/.gdesklets2/Sensors/GoodWeather/um/small_icons/15.png 861d3bc9b9ba0d01487fd5a1396a5aea 2182
/root/.gdesklets2/Sensors/GoodWeather/weather.com/small_icons/28.png 9e56eeb2a7430b234075cc9babb9740b 2184
/root/.gdesklets2/Sensors/GoodWeather/um/small_icons/30.png e0fae7156fdd8c99ff9ce6b179199efb 2200
/root/.gdesklets2/Sensors/GoodWeather/um/small_icons/1.png c5d4d80e06c9e62fbffed1b946276ecd 2226
/root/.firefox/default/wc4he5i9.slt/Cache/AF7694E0d01 307e4ba4b908afeae1e5ebefe3652dc7 22411
/root/.gdesklets2/Sensors/GoodWeather/um/small_icons/37.png cebc3ffc2cbe4120159d2911e35deee3 2308
/root/.mozilla/root/64ytwi2m.slt/search.rdf 26d13f5d96ad118b5de5d234f9d052fa 2335
/root/.gnome2/.gnome-smproxy-9CE77q 441077cc9e57554dd476bdfb8b8b8102 2
/root/.gdesklets2/Sensors/GoodWeather/um/small_icons/17.png 650ce46e93c7f60c966822abe39abd81 2487
/root/.firefox/default/wc4he5i9.slt/Cache/83601A8Cd01 69e98f1a1e3c9a65a943c3602860f5df 25159
/root/.mozilla-thunderbird/default/f20a26zf.slt/Mail/mail.ciacchi.it/msgFilterRules.dat d3271f8ccaad272511d6527b87002715 25
/root/.mozilla/root/64ytwi2m.slt/Cache/80248479d01 cc6d7a03d06418373aa1ffe3a4c6734c 28413
/root/.gnome2/share/cursor-fonts/fonts.dir 897316929176464ebc9ad085f31e7284 2
/root/.thumbnails/large/03e44e48b8c48448807542a26a2e9b48.png f9619dc27c4cba54e97f31b0b6c65dae 3435
/root/.nautilus/metafiles/file:%2F%2F%2Farchivio%2Fcdrom%2Farchivio%2FDocume nti%2520Correnti%2FEmanuele.xml 0193ac450eb23298a51f7b1db64edc70 35
/root/.thumbnails/large/bcd4a27867055c708b4ba9293d9874b0.png 066a86ce7fefb55de82ecfa98dc36ce4 3516
/root/.thumbnails/large/ac649d5be4aa4c7d7c4ef1ccc3c3e8d3.png 78a9268f262b4ac21a8c592ee907df86 3953
/root/.thumbnails/large/fd9701941ec0cc72ba6acbc6c6757197.png be13a95134577e887ebe0be6087dbe48 4385
/root/.macromedia/Macromedia/Flash 0012a31c4609f3cef43df42addc21656 47
/root/.thumbnails/large/4b9ac09a4c031919878f2988a059d0db.png f33c6a30b40f2296c80c76806bdce5c0 5050
/root/.mozilla/root/64ytwi2m.slt/prefs.bak 75a9a2466dff7e8d51a87095597271dc 5226
/root/.firefox/default/wc4he5i9.slt/prefs.bak bde775b975e484e31f3c4ad45788f685 5301
/root/.gdesklets2/Sensors/GoodWeather/liquid/large_icons/22.png 019eb8acab32cbc26be1b02a3b795fb1 5585
/root/.gdesklets2/Sensors/GoodWeather/weather.com/large_icons/23.png 8312312bf3303e2645c3480c05236738 5680
/root/.aMule/emfriends.met c36685fdc1b9a56002040854db2d653e 5

[/supersaibal]

**morfeus** · 14-06-2004, 16:58

con ncheck puoi trovare i file con lo stesso inode.. è poco usato, non lo conosco, fai un man

**virusbye** · 14-06-2004, 17:28

Originariamente inviato da Morfeus
con ncheck puoi trovare i file con lo stesso inode.. è poco usato, non lo conosco, fai un man

provo

Discussione: Cercare file doppioni!

Strumenti discussione

Ricerca discussione

Visualizza

Cercare file doppioni!

Re: Cercare file doppioni!

Re: Re: Cercare file doppioni!

Permessi di invio