#indiewebcamp 2013-11-25

2013-11-25 UTC
mathpunk joined the channel
#
bret Some nice interviews: http://redecentralize.org/interviews/ Anyone here involved with them?
#
bret obviosly the mail pile people ;)
pfenwick, hober, bnvk, tantek, kylewm__, fmarier, scor, obensource_, obensource, skinny, tpinto, snarfed, KevinMarks2, julian`, jp, caseorganic and brixen joined the channel
#
@benwerd Looking at https://spamicity.info/ & wondering if I could use it to check spam on my webmentions (with a mf2-to-AS transform). #indieweb (twitter.com/_/status/404850808300113921)
obensource_, skinny, bnvk, Nadreck, tpinto, Jihaisse, melvster, friedcell and andreypopp joined the channel
#
Jihaisse Hello
tantek, tpinto, caseorganic, pfenwick and pfefferle joined the channel
#
@tondelooijer We just want an #IndieWeb http://indiewebcamp.com/ RT @martijnrijk FB will face its cruel destiny of simply fading away http://thenextweb.com/socialmedia/2013/11/24/facebook-grandparents-need-next-gen-social-network/ (twitter.com/_/status/404901080099594240)
tpinto, pfenwick, LauraJ, bnvk, skinny, skinny_, abrereton, Acidnerd, adactio, ciao, scor, andreypopp, indiewebcamp-vis, brianloveswords, heath and julian` joined the channel
#
@RDBinns Slow home broadband upload speeds = barrier to personal servers, decentralised web http://www.cable.co.uk/guides/how-fast-is-bt-infinity-broadband/ #indieweb @redecentralize (twitter.com/_/status/404976890235981824)
acegiak and skinny joined the channel
#
@No3610 talking HTML templates in #indiewebcamp, @KevinMarks asked for datetime, so I made a formatting format (yo ... http://tantek.com/2013/325/t1/html-templates-indiewebcamp-feed-list (twitter.com/_/status/404995525918736384)
#
@No3610 design Qs when coding a new #indieweb post type: * how should it look as a page? * a feed entry? * in a list of posts? (ttk.me t4T91) (twitter.com/_/status/404995534147964929)
#
@No3610 Event note: * Homebrew Website Club * 2013-11-20 18:30-19:30 * @MozSF 7th fl RSVP: @-reply or webmention more: http://tantek.com/2013/323/t5/event-note-homebrew-website-club (twitter.com/_/status/404995535431413760)
#
Jihaisse yeah : http://motherfuckingwebsite.com/
tantek joined the channel
#
tantek good morning indiewebcamp!
#
tantek you may be interested in noting the following (see "External Groups")
#
tantek http://www.w3.org/2013/socialweb/social-ig-charter.html#coordination
#
tantek http://www.w3.org/2013/socialweb/social-wg-charter.html#coordination
#
tantek who would be interested in participating in either or both of these?
snarfed joined the channel
#
neuro` Good *.* tantek
#
tantek neuro` :)
#
tommorris "social business and federation"
#
tantek tommorris - suggested edits welcome - I was able to ask for and get "IndieWebCamp Community" included in the list of External Groups (in case you missed that ;) )
#
tommorris nice.
#
tantek so, purely hypothetically speaking, if an opportunity arose to co-chair such a Social Web WG, what do you folks think? would that be something that would be worth my or any of our time to do? do you think we could significantly influence the outcome in an indie-positive way?
_6a68 joined the channel
#
tommorris tantek: the Working Group seem to have decided their technologies first rather than their use cases.
#
tommorris they are rather keen on OpenSocial, for instance.
#
tantek tommorris - the context of OpenSocial's inclusion is not exclusive
#
tantek note the other quite open ended deliverables of "Federation Protocol … federation of social data such as profiles and status-updates on the Web is still an unsolved problem"
#
tommorris you know more about the perils of standards bodies than I do. but, yes, if you think you can make a productive contribution, go for it. ;)
#
tantek and "Social Use-Cases and Requirements" explicitly states "Any new features added to existing specifications should involve **clearly documented use-cases** and requirements, either in a document maintained by the Working Group or another Working or Interest Group." **emphasis** mine. That would apply to OpenSocial as well.
bnvk, caseorganic, ozten, tantek, melvster, b0bg0d, srushe_, ryana, _6a68, LauraJ, benprew, snarfed, paulcp, obensource, obensource_ and shaners joined the channel
#
shaners aaronpk: http://indiewebcamp.com/irc/2013-11-19 isn't loading
paulcp joined the channel
#
shaners nm. it was just real slow to load.
tantek joined the channel
#
tantek hey shaners - welcome back :)
#
shaners oh hi
#
shaners tantek: i got a weird @reply on twitter today from you/not-you
#
tantek URL?
#
shaners https://twitter.com/no3610/status/404995552649039872
#
@No3610 @veganstraightedge disagree. Better to post quick note thoughts sooner without expectations of an article (... http://tantek.com/2013/322/t1/post-note-thoughts-sooner-without-expectations-article
#
tantek shaners - that account is duplicating tons of my notes/tweets
#
tantek just reported it as spam - please do so as well
#
tantek !spammer No3610
#
Loqi Got it! There are now 6 spammers blacklisted
#
shaners yeah. what's the deal? people are beard.
#
tantek I have nothing against people with beards. I just don't do it myself. :P
#
shaners http://instantrimshot.com/index.php?sound=rimshot&play=true
paulcp, thatryana, tantek, julio, paulcp_, anselm, b0bg0d, LauraJ, ryana, tpinto, fmarier and mathpunk joined the channel
#
mathpunk aaronpk: ?
#
etymancer mathpunk: yo!
caseorganic and mathpunk joined the channel
#
mathpunk etymancer: hey!
#
mathpunk etymancer: I am attempting to apply to a job despite the posting having been removed, like, immediately
#
mathpunk etymancer: b/c I like to fantasize about being employable
pfenwick, fmarier and abrereton joined the channel
#
etymancer I can understand that
#
etymancer I imagine that means I can't be of much help, though :)
#
aaronpk shaners: yea weird I think the database is missing an index or something, been noticing a way higher load on that server too
paulcp and andreypopp joined the channel
#
mathpunk etymancer: not unless you can get Lynn to stop interrupting me at the exact moment I start to get flow... o_O
#
neuro` aaronpk: any trafix spike?
#
neuro` trafic
#
aaronpk I don't think so
#
etymancer mathpunk: no flow control tips here
#
mathpunk hey it's aaronpk
#
aaronpk sorta hi
#
mathpunk when you're less sorta I wanna grill you on Periscopic. but, carry on
tantek, tantek_, caseorga_, paulcp, LauraJ, tilgovi, lukebrooker, andreypopp, fmarier and CheckDavid joined the channel
#
tantek Also seeing very slow load times on IRC logs.
scor joined the channel
#
tantek Eg /irc/today
caseorganic joined the channel
#
tantek (Not loading for me at all in mobile safari.)
#
aaronpk ooh the poor server
#
aaronpk pretty sure it crashed, one sec
#
tantek Is this a "databases are slow by default" problem? (Ie without tuning / explicit indexes)
#
aaronpk no, this is actually the web server this time. got a spike on some site on the server and it crashed
#
tantek Hmm I wonder if it's that same bot that was hammering my server.
#
tantek Ahrefsbot
#
tantek Check logs.
#
aaronpk brb
caseorganic and CheckDavid joined the channel
#
aaronpk back
#
aaronpk that does sound familiar
#
aaronpk ah, ahrefsbot has been has been crawling aaronparecki.com like crazy
#
aaronpk but not the wiki
#
aaronpk something has been crawling the IRC logs like crazy
#
aaronpk 190.12.79.230
#
Loqi !dns 190.12.79.230
#
Loqi no reverse pointer found
#
aaronpk "Mozilla/4.0 (compatible
#
aaronpk MSIE 5.5
#
aaronpk Windows NT 5.0)"
mathpunk joined the channel
#
aaronpk oh and yeah, missing an index on the DB query used to generate the day pages
tantek joined the channel
#
tantek Re ahrefsbot https://twitter.com/t/status/394417175060303872
#
@t monthly bandwidth exceeded again.
benprew joined the channel
#
aaronpk 50%!!!
#
aaronpk that's insane
#
tantek That's what I thought!
#
aaronpk also, i'm surprised that any crawler can cause you to go over your monthly bandwidth, my limit is like 4TB/mo and I never come close to it
#
tantek I followed their instructions to throttle it in robots.txt which had no effect after 48hrs
#
tantek So blocked it in htaccess
#
aaronpk yeah if they don't honor their own instructions, then screw that
#
tantek Bad robot no 200
#
aaronpk :)
#
tantek They even dared to reply in that twitter thread
#
aaronpk !!
#
tantek No follow up to my complaint that they ignored robots.txt
#
aaronpk wow
#
aaronpk I should add that to my site too then
#
Loqi agreed.
#
bret yikes
#
bret people just run their own bots?
#
tantek If you check their site they claim to be the biggest index of back links
#
aaronpk tantek: is this basically what you did? http://httpd.apache.org/docs/2.2/howto/access.html#env
#
tantek Hmm I have to check my laptop
#
tantek First time on a SWA flight with wifi and allowed to keep devices on!
#
aaronpk that looks like it'll work reasonably well
#
tantek iPod ftw!
#
aaronpk yeah!! nice!
#
bret w00t
#
tantek #iamnotanumber
#
tantek Brb switching wifi
#
KevinMarks why shouldn't people run their own bots?
#
KevinMarks robots.txt that only permits googlebot is ratehr sketchy
tantek_ joined the channel
#
tantek_ aaronpk - I added a RewriteCond to my existing list of RewriteCond(s) to block bad robots
#
bret wasnt trying to say that they shouldn't. Its just anoying people dont monitor their crap and cause problems
#
tantek KevinMarks see above - if they ignore robots.txt they deserve to be blocked
#
tantek aaronpk, here's what I have in summary:
#
tantek in my .htaccess
#
tantek RewriteEngine On
#
tantek RewriteCond %{HTTP_USER_AGENT} "AhrefsBot" [OR] # 2013-299 disobeyed robots.txt Crawl-Delay: 3600
#
tantek RewriteRule .* - [F,L]
#
tantek oops without the [OR] obv
paulcp joined the channel
#
KevinMarks 190.12.70.230 says it's the Instituto Idat in Lima, Peru
#
tantek I got plenty more IPs that I've blocked if you're curious
#
tantek e.g
#
tantek RewriteCond %{REMOTE_ADDR} "200\.218\.170\.14"
#
tantek there were also a bunch of bots that pretended to be IE5.5/NT5.0 (which is like no one)
#
tantek e.g.
#
tantek RewriteCond %{REMOTE_ADDR} "199\.203\.230\.142" [OR] # 20060508 bot disguised as IE5.5/NT5.0, disobeying robots.txt
#
tantek and then there are the bots that appear to be attempting hacks, e.g. requesting www.zip or wwwroot.rar or .mdb files
#
tantek e.g.
#
tantek RewriteCond %{REMOTE_ADDR} "125\.89\.79\.83" [OR] # 2010-018 attempted hacks? requested www.zip wwwroot.rar .mdb files
#
tantek ok have to stow laptop for take-off
#
tantek have fun with the rewrite rules! :)
#
KevinMarks heh. I ran a local server while logged into the salesforce VPN once, and got all kinds of scary fetches from their zone scanner software
#
tantek ooh that's a good idea to run intranet honeypots
#
tantek I wonder if Little Snitch could do that