162 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Jan Lukas Gernert	11d9657bdd	fix using parent if top candidate is only child	2023-03-12 14:20:19 +01:00
Jan Lukas Gernert	14ba2ccb70	add dropbox test	2023-03-12 13:50:06 +01:00
Jan Lukas Gernert	8d529a6d74	fmt	2023-03-12 13:39:29 +01:00
Jan Lukas Gernert	23c156ab2c	add new test	2023-03-12 13:39:17 +01:00
Jan Lukas Gernert	c8bc583864	add exception to conditioal cleaning for list with images	2023-03-12 13:39:10 +01:00
Jan Lukas Gernert	c19525f8cd	add new test	2023-03-12 12:21:00 +01:00
Jan Lukas Gernert	779afd6245	fix cleaning of empty p/div-tags	2023-03-12 12:20:50 +01:00
Jan Lukas Gernert	d9c92ea42c	add new test	2023-03-12 11:56:41 +01:00
Jan Lukas Gernert	fa63d297f8	add new test	2023-03-12 11:53:42 +01:00
Jan Lukas Gernert	c654f63319	add cnn test	2023-03-12 11:42:44 +01:00
Jan Lukas Gernert	58a799b096	fix negative regex & fmt	2023-03-12 11:42:37 +01:00
Jan Lukas Gernert	1e71aa2bfb	remove duplicate code	2023-03-10 22:17:53 +01:00
Jan Lukas Gernert	a356ced646	fix potential infinite loop	2023-03-10 22:17:31 +01:00
Jan Lukas Gernert	6a58e45c7a	add cnet test	2023-03-10 07:05:10 +01:00
Jan Lukas Gernert	a915d8fe67	update some older tests	2023-03-10 06:36:21 +01:00
Jan Lukas Gernert	7b6d22ebc8	add cnet-svg-classes test	2023-03-10 06:33:24 +01:00
Jan Lukas Gernert	3ece2522bb	add clean links test	2023-03-09 21:24:29 +01:00
Jan Lukas Gernert	c5c6b788c8	add citilab test & fix noscript unwrapping	2023-03-09 20:10:03 +01:00
Jan Lukas Gernert	69b7b1fdc2	fix clippy	2023-03-06 01:51:26 +01:00
Jan Lukas Gernert	612f022879	add buzzfeed test	2023-03-06 01:36:37 +01:00
Jan Lukas Gernert	881c2b90ac	fix alternate candidates	2023-03-06 01:36:21 +01:00
Jan Lukas Gernert	45b4141049	add new test	2023-03-06 00:04:23 +01:00
Jan Lukas Gernert	7060e30911	fix conditional clean of nested tags	2023-03-06 00:03:59 +01:00
Jan Lukas Gernert	9c5ffda5de	add breitbart test	2023-03-04 23:40:23 +01:00
Jan Lukas Gernert	f5b7ff198a	fix post processing	2023-03-04 23:40:01 +01:00
Jan Lukas Gernert	2528aa3e18	fmt	2023-03-04 17:55:17 +01:00
Jan Lukas Gernert	e2b804d00a	add blogger test	2023-03-04 17:41:22 +01:00
Jan Lukas Gernert	daa5543c4e	fix turning div's into p's	2023-03-04 17:41:14 +01:00
Jan Lukas Gernert	d93f5c9677	fmt	2023-03-02 01:09:48 +01:00
Jan Lukas Gernert	6964724102	add bbc test	2023-03-02 01:09:44 +01:00
Jan Lukas Gernert	df41e690ae	fix conditional cleaning class weight	2023-03-02 01:08:52 +01:00
Jan Lukas Gernert	02e043f6de	fix negative regex	2023-03-02 01:08:28 +01:00
Jan Lukas Gernert	aaff97c184	cleanup	2023-03-01 01:55:26 +01:00
Jan Lukas Gernert	4031750956	tag cleaning test	2023-03-01 01:37:44 +01:00
Jan Lukas Gernert	7c9e527827	strip iframes but keep vidoes	2023-03-01 01:37:37 +01:00
Jan Lukas Gernert	cea23f1638	always use fakehost url for tests	2023-03-01 00:46:35 +01:00
Jan Lukas Gernert	80de6d177c	url completion test	2023-03-01 00:42:44 +01:00
Jan Lukas Gernert	3a92585f4d	use url.join() instead of custom code	2023-03-01 00:42:03 +01:00
Jan Lukas Gernert	13d147d270	fmt	2023-02-28 18:30:23 +01:00
Jan Lukas Gernert	451dd61547	add two new tests	2023-02-28 18:28:55 +01:00
Jan Lukas Gernert	a1c07d436f	fix alternative top candidate calcs	2023-02-28 18:28:01 +01:00
Jan Lukas Gernert	f4ccd22837	fix node ancestor depth	2023-02-28 18:27:46 +01:00
Jan Lukas Gernert	58721efa35	fix positive/negative class weight regex	2023-02-28 18:27:36 +01:00
Jan Lukas Gernert	aea57d0cf3	fix has_single_tag_inside_element & update tests	2023-02-28 03:59:48 +01:00
Jan Lukas Gernert	31a8033844	fixes, more sanitation & 1 more failing test	2023-02-28 01:50:13 +01:00
Jan Lukas Gernert	56c08c501a	fmt	2023-02-27 01:01:16 +01:00
Jan Lukas Gernert	df999cd9fc	more cleanups & more tests	2023-02-27 01:00:56 +01:00
Jan Lukas Gernert	0834c4d72a	fixes	2023-02-26 02:22:53 +01:00
Jan Lukas Gernert	d8e3a75b01	update configs	2023-02-25 01:40:07 +01:00
Jan Lukas Gernert	2460745547	cleanup	2023-02-25 00:44:18 +01:00