tag:blogger.com,1999:blog-7419966163128750849.post7475252706479303640..comments2023-12-18T04:00:21.706-05:00Comments on Tamer Özsu's Blog: Retrospective on SIGMOD 2014M. Tamer Özsuhttp://www.blogger.com/profile/09829900873506367131noreply@blogger.comBlogger7125tag:blogger.com,1999:blog-7419966163128750849.post-71512648065140308322015-10-27T14:00:26.960-04:002015-10-27T14:00:26.960-04:00Happy New Year 2016 Messages
Happy New Year 2016 ...<b><a href="http://happynewyear2016.presss.org/2015/10/happy-new-year-2016-messages.html" rel="nofollow">Happy New Year 2016 Messages</a><br /><br /><a href="http://happynewyear2016.presss.org/2015/10/happy-new-year-2016-whatsapp-messages.html" rel="nofollow">Happy New Year 2016 SMS</a><br /><br /><a href="http://happynewyear2016.presss.org/2015/10/happy-new-year-2016-images-and-pics.html" rel="nofollow">Happy New Year 2016 Images</a><br /><br /><a href="http://happynewyear2016.presss.org/2015/10/happy-new-year-2016-quotes-and-sms.html" rel="nofollow">Happy New Year 2016 Quotes</a><br /><br /><a href="http://happynewyear2016.presss.org/2015/10/happy-new-year-2016-free-wallpaper.html" rel="nofollow">Happy New Year 2016 Wallpaper</a><br /><br /><a href="http://happydiwali.presss.org/2015/10/happy-diwali-wishes-hd-wallpaper-for.html" rel="nofollow">Happy Diwali Wishes wallpaper</a><br /><br /><a href="http://happydiwali.presss.org/2015/10/happy-diwali-pictures-desktop-wallpaper.html" rel="nofollow">Happy Diwali Pictures</a><br /><br /><a href="http://happydiwali.presss.org/2015/10/happy-diwali-wallpaper-for-desktop.html" rel="nofollow">Happy Diwali Wallpaper for desktop</a><br /><br /><a href="http://happydiwali.presss.org/2015/10/happy-diwali-free-hd-wallpaper.html" rel="nofollow">Happy Diwali Free wallpaper</a><br /><br /><a href="http://happydiwali.presss.org/2015/10/happy-diwali-hd-wallpaper-for-free.html" rel="nofollow">Happy Diwali HD Wallpaper</a></b><br />Ahirhttps://www.blogger.com/profile/02302541363180322909noreply@blogger.comtag:blogger.com,1999:blog-7419966163128750849.post-65405621863260982692014-08-19T19:07:04.532-04:002014-08-19T19:07:04.532-04:00I agree Sara. That probably is a contributing fact...I agree Sara. That probably is a contributing factor to the changes in the distribution of papers that we observe with double blind.M. Tamer Özsuhttps://www.blogger.com/profile/09829900873506367131noreply@blogger.comtag:blogger.com,1999:blog-7419966163128750849.post-63318309326722461712014-08-18T20:08:23.864-04:002014-08-18T20:08:23.864-04:00Given the well-documented effects of individual bi...Given the well-documented effects of individual bias induced by a person's name alone, as well as bias in peer-review (see: http://advance.cornell.edu/documents/nepotism_and_sexism.pdf, http://www.pnas.org/content/early/2012/09/14/1211286109, <br />and http://papers.ssrn.com/sol3/papers.cfm?abstract_id=2063742 to list but a few points in a very large body of research), you ought to need a really good reason for not using double blind.Sarahttps://www.blogger.com/profile/12578835022055550598noreply@blogger.comtag:blogger.com,1999:blog-7419966163128750849.post-25373754693792608742014-08-17T12:22:03.841-04:002014-08-17T12:22:03.841-04:00Part of it is easy -- no one who said "unwill...Part of it is easy -- no one who said "unwilling to review" got the paper assigned to the, and almost everyone who indicated they were "eager" to review a paper got them. However, the challenge is that there are not too many in "eager" category, so you struggle when you do assignments. For example, I tried a more even distribution of papers among reviewers by setting the minimum and maximum assignments close to each other, but CMT was not able to find a satisfiable allocation. Then you start increasing the maximum that can be assigned and eventually you find a satisfiable solution. Another difficulty is that many reviewers simply indicate what they would be willing to review (in various categories) and what they would definitely not be willing to review, but leave the others in their default settings. The allocation algorithm treats these as "I don't care" and not "I don't want to", and reviewers are sometimes surprised when they see these papers assigned to them. I did do some reallocation manually to deal with a few of these issues.M. Tamer Özsuhttps://www.blogger.com/profile/09829900873506367131noreply@blogger.comtag:blogger.com,1999:blog-7419966163128750849.post-65360941864686982832014-08-17T12:16:56.950-04:002014-08-17T12:16:56.950-04:00I would be interested to hear what kind of statist...I would be interested to hear what kind of statistics and data you would like to see. My comment is mainly in response to the often heard claim that double blind causes undue difficulties -- that was not the case this year. The other issue is with respect to distribution of papers to institutions and countries -- that is significantly improved with the introduction of double blind. A few years ago I had conducted (albeit unscientific) study of the distribution for the five years immediately preceding the introduction of double blind and the five years immediately following it, and the results demonstrated the variability. There is an earlier study by Anthony Tung (http://dl.acm.org/citation.cfm?doid=1168092.1168093) that confirms the same.M. Tamer Özsuhttps://www.blogger.com/profile/09829900873506367131noreply@blogger.comtag:blogger.com,1999:blog-7419966163128750849.post-58813330926445914952014-08-06T16:17:57.608-04:002014-08-06T16:17:57.608-04:00One statistic I'd like to see, is the quality ...One statistic I'd like to see, is the quality of matching papers to reviewers. As a simple measure; how many reviews were done by reviewers who bid as "eager" to do the review, compared to the number who said they'd do it "in a pinch" or even "unwilling to review".Alanhttps://www.blogger.com/profile/18066081924626392584noreply@blogger.comtag:blogger.com,1999:blog-7419966163128750849.post-48130996056120004192014-08-06T14:53:04.179-04:002014-08-06T14:53:04.179-04:00"Double-blind is working very well and we sho..."Double-blind is working very well and we should maintain it."<br /><br />As a leading research in a very data-driven domain, can you provide some data and statistics to back this claim up?rxinhttps://www.blogger.com/profile/12390803677371720510noreply@blogger.com