Jump to content

Talk:Critical issues presentations

From Wikimania 2016 • Esino Lario, Italy
Latest comment: 8 years ago by Blahma in topic Wrong license for presentations?

Notification of acceptance

the result will be announced today ? --Touzrimounir (talk) 11:21, 27 January 2016 (UTC)Reply

@MLWatts, Marcok: ping. --Yiyi 11:40, 27 January 2016 (UTC)Reply
I edited the page reflecting the recent postponing of the date of the notification of acceptance. Here is the message I sent to the Wikimania mailing list today:
Dear all,
This is to inform you that the assessment phase for the submissions we received for our "Critical Issues" talks at Wikimania 2016 is in progress. The reviews are, however, taking more time than initially expected; the members of the Programme Committee needed some effort to get familiar with the EasyChair conference platform we are using, which, as I can testify having configured it and managed it so far, is not entirely intuitive to interact with. Needing more time to complete the reviews, we have to postpone the date of the notification of acceptance to February 1st. If you need further information, please do not hesitate to ask.
Sorry for the inconvenience to all who are affected.
Yours, --MLWatts (talk) 19:43, 27 January 2016 (UTC)Reply
@MLWatts: I think the result should be announced yesterday --Touzrimounir (talk) 08:46, 2 February 2016 (UTC)Reply
I'm sorry, we're doing our best. --MLWatts (talk) 11:09, 2 February 2016 (UTC)Reply

We are sorry for the delay. but we decided to only allow ourselves 2 weeks for the reviews (which is quite complicated with a new system and we did not know how long it takes): we set such a short time to make sure we could provide the reviews to the committee evaluating the scholarships; we want people who are selected for the programme to have good chances to actually get a scholarship to come. Bridging together the two processes is not obvious but we trust it makes sense. The short delay did not compromise the objective. Thank you very much to all the reviewers for the great work and the fast and effective response! Thanks to the people who got involved last minute to fill gaps and thanks to MLWatts (WAW!) and Marcok for the management of this experiment. --iopensa (talk) 09:56, 4 February 2016 (UTC)Reply

Feedback and Evaluation

WHY

Background. Please note that we have been working on the Wikimania program since August 2013 with discussions among former participants, an analysis of the comments and feedback of previous editions, a comparative analysis of the previous programs and formats, and a meeting at Wikimania Mexico City. You find the program described already when we submitted the bid for 2015 and then updated for 2016 and our objective for the program in 2016 is to increase the number of informal gatherings, to create a program suitable for different attendees and to experiment new systems.

The specific reasons why we introduced a blind peer-review process for a selection of presentations (not all of them) is specifically to respond to a series of issues. a. We had the impression that our current selection process on wiki does not allow new people to get in (maybe it is also due to the fact that when you decide between a 9 and 10 if you know the person it is easier to give a higher score: please note that the selection is really between the highest scores). b. For many years the reviewers where more or less always the same and - even if they are great people - we wanted to boost some change. We made a call for new reviewers and you are more than welcome to get involved in the future. More reviewers more reviews. c. We had the impression that there are too many presentations from wmf. I think the staff of wmf has been presenting great proposals, but maybe we need less great proposals and more involvement of other people, simply because we want to hear what they have to say and we need to make space for them (for this reason we set a limit for the presentations of wmf staff members).

B PLAN. At Wikimania Esino Lario there are different processes to submit proposals: critical issues are reviewed (42 presentations of this kind are included in the conference), but you can also suggest in different ways and with different coordinators talks, topics, posters, trainings, discussions, special guests and meetups. Submissions presented as “critical issues” which do not fit the format, can be moved to other sessions (you can resubmit them and we will do it too by looking at the “non selected”).

Thank you. Thanks to everyone who submitted his/her ideas and contributions and thanks to the reviewers who participating in highlighting their favorite topics/approaches. A review is never a neutral process but we trust there is always respect for the work of everyone involved. Thanks! --iopensa (talk) 09:31, 4 February 2016 (UTC)Reply

Weakness of the peer-review process (please sign your comment)

Strengths of the peer-review process (please sign your comment)


Does the reviewers followed the criteria ?

Well I think that double blind peer review hardly make sense here, at least from the reviewer POV, as we are in fact small community and it is easy to guess who was a submiter in most cases.

Also judging from the several reviewers comments which I saw already - they did not follow the very vague criteria which was posted here:

https://wikimania2016.wikimedia.org/wiki/Critical_issues_presentations#Evaluation

Normally - at least in Academia - reviewers are forced directly (by the review form) to address their opinion in relation to the criteria. The criteria were:

   problems and possible solutions in a specific field
   proposals for others to replicate
   issues (positive or negative) which have emerged from projects
   issues you want to raise which you feel have not been discussed yet
   issues which are at the centre of an online debate that you would like to address offline

1-4 are IMHO relatively easy to evaluate - I would expect from the reviewers to answer yes or no to them. 5 is a bit tricky as it depends strongly of what the reviewer think is "at the centre" - but I would expect that they at least explain in few words here what they think is "at the centre" or not :-).

The other issue is - that having such a vague criteria and having only 2 reviewers - the results very much depends on those 2 reviewer POV - and in fact actually just one - as one negative opinion was usually enough to reject submission even if the second one was positive. Polimerek (talk) 11:02, 4 February 2016 (UTC)Reply

Wrong license for presentations?

Hello, I am afraid that, technically, the requirement to release presentation slides and have the presentation recorded and broadcasted under "Creative Commons Attribution Share-Alike Licence 3.0" prohibits the display of the Wikimania 2016 logo anywhere on the slides, around the speaker etc. That's because the logo is licensed under CC BY-SA 4.0 and, if I am not mistaken, if you reuse something that is under 4.0, you need to release it under 4.0 again, not 3.0. I appreciate the effort for presentations under free licenses, but 4.0 might have been a better choice. --Blahma (talk) 11:39, 24 June 2016 (UTC)Reply