After looking through the help, wiki, and forum I think I have a general idea about why my uploads aren't being approved, at least in a timely consistent fashion. Not sure if the current batch will hit 30 days or not, but only a few days in so far. I've got ~200 submissions more to go right now.
Has anyone considered taking advantage of the rating and favorites system to extend the deletion threshold and trigger automatic (conditional/full) approval?
So for example
if favorites + score > x then extend life by n days
if favorites + score > y then conditional auto approve (no auto deletion)
if age > 90 days and there are no negative (blacklisted) tags or flags then automatically fully approve
A formula version for the extension of life
n = (f+s)^1.25
For y I'm thinking 40 is a good number based on what I'm seeing to trigger conditional auto approval.
Then humans can focus on spot checking and reviewing flagged items
For quality control...
Tags or a score system could be added for quality to help crowd source identifying submissions that don't meet quality, and personally I'd like to just search using something like this.
- One category or score for level/style of realism
- One category or score for artifacts and quality issues
I wouldn't mind doing a quick score on the quality on a lot of what I look at if it was a simple system. Especially the ones I really like or don't like. Most would be in the middle, the 80% majority, would probably be unscored or neutral which would be fine in an approach like this.
Rather than complain about one man holding up the place (from what I've been able to discern), I'd like to propose the above as a way to possibly help alleviate some of the issues.
Some of this can probably be done with a simple perl or python script using restful calls. Other bits are going to be changes to the site. If there is an api call that can adjust the auto-deletion threshold on each submission then the important part of this suggestion could be implemented quickly. Likely less than a day including testing. Tags can be used initially in lieu of adding new states, though they would be tags normal users couldn't add or remove.
This should hopefully keep the approvals flowing enabling folks to keep uploading while significantly reducing the workload on the Janitors. If an uploader's work isn't being well received it'll be a bit of a throttle on those as well, but I believe these numbers should produce good results most everyone can live with. I would expect that the majority of conditional approvals would be done in about 2 days with stragglers needing the full 90 days. That will probably leave a small number for the Janitors to actually keep up with. This should also scale well as the site grows.
This doesn't address certain issues such as identify inappropriate content that needs to be purged immediately, but I bet someone here could work out an AI based classifier that could flag the most likely suspects for review. The same utility may be able to attempt auto tagging as well and could be baked into the upload process.
The formatting isn't nice, but this is a quick table I threw together to work out the power needed for something reasonable to work with y.
Score Favorites Total Days extended Deletion Threshold Pow
1 1 2 2.4 32.4 1.25
2 2 4 5.7 35.7
3 3 6 9.4 39.4
4 4 8 13.5 43.5
5 5 10 17.8 47.8
6 6 12 22.3 52.3
7 7 14 27.1 57.1
8 8 16 32.0 62.0
9 9 18 37.1 67.1
10 10 20 42.3 72.3
11 11 22 47.6 77.6
12 12 24 53.1 83.1
13 13 26 58.7 88.7
--- Automatic Full Approval if no negative flags after 90 days ---
14 14 28 64.4 94.4
15 15 30 70.2 100.2
16 16 32 76.1 106.1
17 17 34 82.1 112.1
18 18 36 88.2 118.2
--- Conditional Auto Approval (No auto delete) anytime with status:pending ---
19 19 38 94.3 124.3
20 20 40 100.6 130.6
21 21 42 106.9 136.9
22 22 44 113.3 143.3
23 23 46 119.8 149.8
24 24 48 126.3 156.3
25 25 50 133.0 163.0
26 26 52 139.6 169.6
27 27 54 146.4 176.4
28 28 56 153.2 183.2
29 29 58 160.1 190.1
30 30 60 167.0 197.0
31 31 62 174.0 204.0
32 32 64 181.0 211.0
33 33 66 188.1 218.1
34 34 68 195.3 225.3
Updated