[06:50] < Lawouach_> morning
[07:54] *** mhrd-sometimes-a has joined #kamaelia
[09:12] *** Uraeus has joined #kamaelia
[09:47] *** orphans has joined #kamaelia
[10:21] *** Davbo has joined #kamaelia
[10:31] < Davbo> hi all
[10:33] < orphans> hey Davbo
[10:55] < Davbo> Hey orphans, not many people around today
[11:04] < orphans> nah, quiet :)
[11:05] < orphans> I'm literally dying of hayfever too - it's quite fun to try and hold a tissue and type at the same time
[11:08] *** MS- has joined #kamaelia
[11:09] < MS-> afternoon
[11:09] < Davbo> me too orphans
[11:09] < Davbo> Afternoon, MS-
[11:10] < Davbo> orphans, you should co my XYPad, got a cool way to keep track of the selected colour
[11:11] < Davbo> /Sketches/DK/Kamaelia-Paint/App
[11:11] < orphans> cool, I'll check it out
[11:11] < Davbo> You alright MS-?
[11:12] < orphans> hey MS-
[11:12] < MS-> yep - I'm fine - just rather busy - I have some tight deadlines at the moment, that's all :)
[11:12] < Davbo> I'll leave you to it then
[11:13] < orphans> wooh, that's pretty fancy Davbo
[11:14] < Davbo> hehe
[11:15] < Davbo> your code gave me the idea, so you can take all the credit ;-)
[11:16] < orphans> :)
[11:20] *** orphans goes to eat chilli sauce for lunch - hayfever will be defeated by chilli
[11:35] *** PJ_Coudert has joined #kamaelia
[12:37] < Davbo> MS-: ImportError: No module named MultiPipeline :-(
[12:37] *** Davbo wonders why it's died again
[12:41] *** Davbo has joined #kamaelia
[12:41] < Davbo> weird
[12:42] < Davbo> hmm, is my IRC working?
[12:42] < orphans> Davbo, pong!
[12:42] < Davbo> Pidgin just went insane
[12:42] < Davbo> ty orphans
[12:42] < Davbo> Agh what's it doing lol. brb
[12:43] < MS-> Davbo wonders why it's died again
[12:43] < MS-> probably your sys.path is askew
[12:43] < MS-> or missing something
[12:43] < Davbo> Yeah, 1 moment MS- I got to just restart Pidgin
[12:43] < Davbo> Again
[12:43] *** Davbo has joined #kamaelia
[12:44] < Davbo> This will do
[12:44] < Davbo> Oh yes MS-
[12:44] < Davbo> sorry
[12:44] < Davbo> :-)
[12:46] < Davbo> Thanks MS-
[12:50] *** Uraeus has joined #kamaelia
[12:50] < Davbo> MS-: Since MagnaDoodle has changed quite a lot, well my copy. I've put # Licensed to the BBC under a Contributor Agreement: THF/DK
[12:52] < Davbo> Since I don't want to get in any bother, is it alright to put down 2 like that?
[12:57] *** matthew-p has joined #kamaelia
[13:01] < matthew-p> Hi michael?
[13:02] < Davbo> ping MS-
[13:03] *** Trun has joined #kamaelia
[13:05] < Davbo> I think he's busy atm matthew-p
[13:56] < matthew-p> no worries - thanks :)
[13:58] < MS-> matthew-p: hiya
[14:01] < Davbo> quick question MS- if you've got time
[14:01] < Davbo> will rgbutton.link( (rgbutton,"outbox"), (self,"buttons") ) do what i expect it to
[14:02] < Davbo> I want some buttons on this thing but I want to define them in the main code
[14:02] < MS-> it's better to do
[14:02] < MS-> self.link( (subcomponent, "outbox"), (self, "inbox"))
[14:03] < Davbo> ah yes, i've seen that
[14:03] < Davbo> thank you, sorry
[14:03] < Davbo> I'd forgot how that would be appropriate for the buttons :-)
[14:03] < MS-> doing
[14:03] < MS-> foo = SomeComponent()
[14:03] < MS-> foo.link( (foo, "out"), (bar, "in") )
[14:03] < MS-> will work, but isn't defined to work that way - and as a result IIRC isn't tested that way
[14:04] < MS-> How goes things btw?
[14:04] < Davbo> Going well
[14:04] < MS-> Looks like you're steadily moving forward
[14:04] < MS-> which is good to see :)
[14:04] < MS-> I'll get the multiprocess stuff merged this week btw, since it's going in the release candidate
[14:04] < Davbo> Picking up speed now MS-
[14:05] < MS-> cool
[14:05] < Davbo> :-)
[14:06] < Davbo> Happy with how the XYPad worked out
[14:06] < Davbo> Thanks to some friendly code on orphans side
[14:07] < MS-> cool
[14:07] < MS-> I saw that - it looked nice. I've got some ideas for how to develop it, but it does look good
[14:08] < Davbo> cool
[14:09] < MS-> (will mail you about them though on the usual "take them or leave them" basis :) )
[14:09] < MS-> might not fit in with your plans after all :)
[14:09] < Davbo> Yeah, sounds good. I didn't want to redraw the background which is why it has worked out like it has
[14:10] *** MS- nods
[14:10] < MS-> There is probably a nice cheat to be had, thinking about it - using alpha channels/transparency
[14:10] < MS-> (he says realising that just at that instant)
[14:11] < Davbo> needs another bit for controlling Saturation too but it can wait
[14:11] < Davbo> rather get it functional
[14:11] *** MS- nods
[14:18] < matthew-p> right - I'm back - Hi MS - I've got a completely off-topic question
[14:18] *** Lawouach_ shakes head as how the French media handle the Euro and the mess the French team put itself
[14:18] < matthew-p> do you know anything about the BBC p2p-next project?
[14:19] < matthew-p> and is it something that might be interesting to work on!?
[14:20] < MS-> a little - I know the person running it - George Wright. It strikes me as something interesting to work on
[14:21] < MS-> It's something that I may get dragged into (voluntarily) after my current project is over.
[14:21] < MS-> It's likely because it's a python heavy project, and as a result we're likely to bring kamaelia to the table, so it's not entirely off topic :-)
[14:22] < MS-> If so, it'll be justification for me getting to spend my day time work on Kamaelia (in addition to george's team I'd guess), so to me it's a highly interesting project
[14:22] < MS-> It's core technology at present is tribler from Delft university
[14:23] < MS-> Which is based on bit torrent
[14:24] < MS-> There was a workshop in Delft on May 27th actually - I wasn't able to go due to personal commitments, but there's a large wadge of docs online
[14:24] < MS-> http://www.tribler.org/TriblerCourse
[14:24] < matthew-p> right-o. Sounds interesting.
[14:24] < matthew-p> Looking at this job posting: http://jobs.bbc.co.uk/fe/tpl_bbc01.asp?newms=jj&id=22405&aid=15172
[14:25] < MS-> Guessed that might be the case :-)
[14:26] < MS-> FWIW, George has IMO very much got his head screwed on the right way and has championed all sorts of new and good working practices as well
[14:26] < matthew-p> that's encouraging
[14:26] < MS-> He's pro-open source, pro python as well :)
[14:26] < matthew-p> all good then
[14:27] < MS-> But also very focussed on doing stuff directly relevant and useful to the business
[14:28] < Lawouach_> Hah. Lucky I'm not in London, that job would have interested me :)
[14:29] < Lawouach_> Damn the guys at Radio Labs really do foxy stuff:
[14:29] < Lawouach_> http://www.bbc.co.uk/blogs/radiolabs/2008/06/wikipedia_plus_lucene_morelikethis.shtml
[14:30] < MS-> Lawouach_: he'd probably be more than interested in multiple good people I suspect. He's happy about people commuting periodically depending on where they're based, but I'm not sure he'd go for international...
[14:30] < Lawouach_> Well I'd be surprised about that too. The problem anyway is that currently I'm not looking at moving.
[14:31] < Lawouach_> I've moved so many times in the last few years that I need to settle a bit.
[14:31] < Lawouach_> and London is too expensive
[14:31] *** MS- nods
[14:31] < Lawouach_> I had a contract over there in January, a permanent job, I declined because London is just too expensive right now
[14:31] *** matthew-p nods sadly
[14:32] < matthew-p> thanks for the appraisal Michael
[14:33] < MS-> you're welcome.
[14:33] < MS-> fwiw, if I was still based in london, there's an internally advertised post as well which I think is part of the same group, and I'd probably've been relatively seriously interested in
[14:34] < MS-> Fair amount of opportunity for growing things up here at the moment, which is often the case if you're an early mover :)
[14:34] < Lawouach_> I find interesting that the BBC wastes so much money in keeping their IT in London when they could consider going outside
[14:34] < matthew-p> sounds like you made a good choice on a number of grounds
[14:35] < Lawouach_> Business parks are so common in the UK
[14:35] < MS-> Lawouach_: http://www.guardian.co.uk/media/2008/jun/08/bbc.radio
[14:35] < Lawouach_> Hah!
[14:35] < Davbo> is BBC Manchester the biggest site after London?
[14:36] < Davbo> I don't think they have much in Sheffield
[14:36] < MS-> Davbo: It probably will be in 2011, though I think Birmgham is biggest outside london at present
[14:36] < Davbo> Oh cool
[14:37] < Lawouach_> It's one thing to move out of London and another to go as far as Manchester
[14:37] < Lawouach_> It's not just about money and houses, it's also the life people have built where they are
[14:37] < MS-> That article isn't very fair BTW - they haven't actually made that package generally available yet. Its only in R&I that anyone has had any offer, and there's all sorts of catches
[14:38] < Davbo> I really like Sheffield so will preferably stay here, lots of tech stuff here anywho.
[14:38] < Lawouach_> okay
[14:38] < MS-> also, it's not quite as few as the numbers indicated
[14:38] < MS-> Lawouach_: That said, the BBC web infrastructure is run out of maidenhead
[14:38] < MS-> In terms of infrastructure.
[14:42] < orphans> Lawouach_, hey, saw the email about your holiday, do you want to have a quick meeting on thurs?
[14:44] < MS-> matthew-p: How's life been since Pycon UK btw? Been a while since we've chatted. Hope it's been treating you well :)
[14:50] < Lawouach_> orphans: if you're up for it yeah :)
[14:51] < Lawouach_> MS-: maidenhead. Dang. I used to live in Reading and never knew that
[14:51] < orphans> Lawouach_, cool, what time?
[14:52] < MS-> It's mainly operations stuff there (network infrastructure level) though rather than application level (or higher) infrastructure
[14:52] < MS-> AIUI
[14:52] < Davbo> lots of "Data Centres" and that in Maidenhead aren't there?
[14:53] < Davbo> My traceroutes usually hop through it
[14:53] < MS-> That may be due to your ISP
[14:53] < MS-> (where they have their transit routes etc)
[14:57] < Lawouach_> orphans: usual time if you're okay with it
[14:58] < orphans> Lawouach_, yeah, np
[14:58] < Lawouach_> cool
[15:05] < matthew-p> I'm back again MS: Life's been good since Pycon UK. I left MPC, had a child, got to write a new version of the system I presented at MPC but in the public domain...
[15:05] < MS-> cool
[15:06] < MS-> Do you have a link anychance ?
[15:06] < matthew-p> I'm really looking for contract work whilst I get some other business off the ground, but equally if really interesting opportunities turn up I take a look, and the job we were just looking at seemed interesting.
[15:06] < MS-> I see
[15:06] < matthew-p> I do have a link... and in fact you are about to receive a mail as you're on my 'to notify' list - I pushed out a version 0.0.1 last night
[15:06] < MS-> Cool :-)
[15:06] < MS-> you knew I'd be interested then :)
[15:07] < matthew-p> I'm psychic :)
[15:08] < matthew-p> it's very 'early release' code, if you see what I mean. Going in the right direction though.
[15:08] < matthew-p> http://www.peloton-grid.net/
[15:09] < Lawouach_> Twisted!
[15:09] < Lawouach_> where's my cross?
[15:10] < Davbo> Hah Lawouach_
[15:11] < Lawouach_> http://www.peloton-grid.net/docs/api/peloton.plugins.amqpQpid.AMQPEventBus-class.html
[15:11] < Lawouach_> That's nice
[15:12] *** MS- looks
[15:14] < MS-> one little silly/trivial suggestion : change "Last modified April 1st 2008" to "Last modified April 2nd 2008" - I always look at pages with that date with suspicion. :)
[15:14] *** MS- keeps looking :)
[15:14] < matthew-p> ha ha!!
[15:14] < matthew-p> ok :)
[15:16] < matthew-p> Lawouach: AMQP is really nice, I think, but ideally in a twisted app we could do with a twisted implentation of the client end. Still, the code works :)
[15:17] < matthew-p> bit too much in the way of thread-work going on though
[15:17] < MS-> The system looks good - a solid starting point
[15:17] < matthew-p> thanks
[15:18] < MS-> :)
[15:18] < matthew-p> trying to concentrate on robust implementation rather than just adding features
[15:18] < matthew-p> so done a lot of testing with many nodes, randomly killing them and so on
[15:18] < matthew-p> all good fun
[15:18] < MS-> Yes, that stage is always the hardest point.
[15:19] < matthew-p> it'll be interesting to see if anyone takes it to do things completely different to what I imagined
[15:19] < MS-> We're mainly at the fleshing out components stage at the moment
[15:19] < MS-> Indeed
[15:19] < matthew-p> met James Gardner, the Pylons author, the other night and he had some interesting ideas
[15:19] < matthew-p> I mentioned Kamaelia to him as well as it had relevance to some of his projects
[15:19] < MS-> Cool.
[15:20] < MS-> Incidentally, we have a gsoc student this summer working on our wsgi implementation, getting it to a robust/deployable stage (in the context of a more general project)
[15:20] < MS-> which should be useful for pylons as well
[15:21] < matthew-p> that's neat - I must have a look at the new work going on in Kamaelia-land
[15:22] < matthew-p> I need a good project to use it on really!
[15:22] < MS-> :)
[15:23] < MS-> We've got nascent multicore support in the system now btw
[15:23] < MS-> Which is possibly the largest small addition to the system
[15:23] < MS-> It's still settling down, but will be in a release candidate this weekend
[15:23] < MS-> The usage for the release candidate will be limited (probably) to just pipelines of the following form:
[15:24] < MS-> ProcessPipeline(Source, Transformer, Transformer, Transformer, Sink)
[15:24] < MS-> ie exactly the same usage as Pipeline:
[15:24] < MS-> Pipeline(Source, Transformer, Transformer, Transformer, Sink)
[15:25] < MS-> Just that the components in the pipeline are shipped off to their own process, and hence able to use a different core
[15:25] < matthew-p> that's very cute
[15:25] < matthew-p> will make it attractive for a new range of problems I'd have thought
[15:25] < Davbo> Speaking of which: http://www.davbo.org/images/snapshot9.png
[15:25] < MS-> There was support for Graphlines, but it exposed an issue with one of the mechanisms used, so i've rewritten it, and taking merging slow :)
[15:26] < MS-> but it does work :)
[15:26] < MS-> Davbo: hah! :-)
[15:26] < MS-> Cool
[15:26] *** Davbo wonders why his buttons aren't showing up
[15:26] < orphans> Davbo, I can hear photoshop quaking in their boots :)
[15:27] < Davbo> hah :-D
[15:27] < MS-> matthew-p: Davbo's writing a paint program using Kamaelia - which means it can open multiple pygame windows happily :)
[15:27] < matthew-p> also cute :)
[15:27] < MS-> (and it kinda proves it's using multiple cores, since you wouldn't be able to open the multiple pygame windows otherwise due to pygame/SDL restrictions :) )
[15:28] < matthew-p> image processing via graphs of processes... GEGL in Kamaelia, no!?
[15:28] < MS-> heh :)
[15:29] *** vmlemon__ has joined #kamaelia
[15:29] *** vmlemon__ is now known as vmlemon_
[15:30] < vmlemon_> Hi
[15:30] *** MS- goes to catch a tram
[15:30] < MS-> biab
[15:30] < MS-> cya
[15:30] *** MS- has parted #kamaelia
[16:07] *** j_baker has joined #kamaelia
[16:30] *** MS- has joined #kamaelia
[16:30] < MS-> back :)
[16:47] < Lawouach> so am I
[16:48] < Davbo> Hmm...where did that .pyc come from?
[16:48] < Davbo> Will investigate later! Time to get food
[16:48] < MS-> Davbo: behind the sofa
[16:49] < Davbo> Back later chaps
[16:49] < Davbo> :-)
[16:49] < j_baker> I always find things under the cushions
[16:49] < Davbo> MS-: Try running Paint.py you'll see what I mean
[16:49] < Davbo> Back later
[16:50] *** MS- does an svn update
[16:53] *** MS- notes that the paint program does what it says on the tin
[16:54] < MS-> I see
[16:54] *** MS- notes that Davbo didn't realise that XYPad.pyc would get created
[17:01] < vmlemon_> "Argh! There's a snake! In my sofa!" ;)
[17:07] *** vmlemon_ found one of the old Usbourne(?) books with the box-hopping robots, last night
[17:19] < MS-> Cool :)
[17:21] < vmlemon_> I don't have it handy, but it contains BASIC and assembler/"machine code" examples, if I remember correctly
[17:22] < MS-> Yep
[17:22] < MS-> I would expect that
[17:22] < MS-> the Usborne books used to have both Z80 and 6502 assembler in
[17:22] < MS-> 6502 always truck me as the nicer of the two
[17:56] *** mhrd-sometimes-a liked 6502
[17:57] < MS-> Oh, hiya
[17:58] < mhrd-sometimes-a> MASHED-TV is up and running in the downstairs lab (it stopped crashing :-) ) ... tune into it when broadcasting starts at MASHED in Ally Pally this weekend :-)
[17:58] < mhrd-sometimes-a> greetings
[17:58] < MS-> Cool
[17:58] < MS-> I don't suppose you have the frequencies and pids do you?
[17:58] < mhrd-sometimes-a> steve is preparing instructions and an initial channel scan tuning file for linux users
[17:59] < MS-> I've found this:
[17:59] < MS-> http://mashed08.backnetwork.com/event/?articleid=24
[17:59] < MS-> Which has a tuning file with this in:
[17:59] < MS-> T 594000000 8MHz 2/3 NONE QAM64 2k 1/32 NONE
[17:59] < mhrd-sometimes-a> ah, he's already done it
[17:59] < mhrd-sometimes-a> yep, those are the params
[17:59] < vmlemon_> Mashed?
[17:59] < MS-> But having pids would enable a nice quick and dirty example in kamaelia's tree for (say) capturing bbc one
[17:59] < MS-> Or is it on the usual pids
[18:00] < MS-> vmlemon_: A hack day thing in london
[18:00] < vmlemon_> Aah, cool
[18:00] < mhrd-sometimes-a> you should be able to use that as input to dvbscan to get a channels.conf (btw: do you want to put that into the release? - I can flesh out its docs)
[18:00] < mhrd-sometimes-a> not sure about pids
[18:00] < mhrd-sometimes-a> will have to check ...
[18:00] < MS-> vmlemon_ : Sigh up page http://mashed08.eventbrite.com/
[18:00] < mhrd-sometimes-a> there is an unholy alliance of windows and linux involved in putting the channel together ;-)
[18:01] < vmlemon_> Any Smash involved? ;)
[18:01] < mhrd-sometimes-a> *@£! ... must have forgotten to set up the network connection properly ... will check tomorrow, but iirc they are probably the usual crystal palace pids
[18:01] < MS-> free buses between from liverpool, manchester, sheffield, newcastle, cardiff & bristol
[18:01] < MS-> cheers
[18:02] < mhrd-sometimes-a> I've got to get round to documenting the playout system ... so that others who will actually be there can operate it ;-)
[18:02] < MS-> That said, given the buses are at an unholy time of the night, I'll be going down on friday
[18:02] < MS-> cool
[18:03] < MS-> mhrd-sometimes-a: This'll be the first time that kamaelia's been used on the playout side :)
[18:03] < MS-> Even if it's just a part of the puzzle :)
[18:04] < mhrd-sometimes-a> there is just a teeny smidgen of kamaelia in there - used to get clock synchonisation between transport streams
[18:04] < MS-> What happened with all the code you wrote?
[18:04] < MS-> OOI?
[18:04] < mhrd-sometimes-a> ?
[18:04] < mhrd-sometimes-a> s/happened/will happen/ ?
[18:04] < MS-> You were writing what looked like a ton of code :)
[18:05] < MS-> which looked like for mashed :)
[18:05] < mhrd-sometimes-a> I've written nearly an order of magnitude more than that :)
[18:05] < MS-> https://kamaelia.svn.sourceforge.net/svnroot/kamaelia/trunk/Sketches/MH/DVB_PSI
[18:06] < MS-> well, yes, I know you're written metric buttloads of DVB code for kamaelia :)
[18:06] < MS-> Which is cool :)
[18:06] < mhrd-sometimes-a> I stopped checking into there after a while since we set up a separate repository for mashed tv code
[18:06] < MS-> I was merely referring to the check in cide bombs ;)
[18:06] < mhrd-sometimes-a> but some stuff can be rolled back into kamaelia
[18:06] < MS-> ahh, I see
[18:06] < MS-> It'd be great to see that stuff merged back in
[18:07] < mhrd-sometimes-a> indeed
[18:07] < MS-> I know George Wright has plans for kamaelia (at least on some level), so having that stuff there would just make his life easier :)
[18:07] < mhrd-sometimes-a> the vast majority is not kamaelia code
[18:07] < mhrd-sometimes-a> and some is very hacky
[18:07] < mhrd-sometimes-a> but I'm happy to 'donate' pretty much anything that we reckon could be of use
[18:07] < mhrd-sometimes-a> back to kamaelia
[18:07] < MS-> hacky == not a problem (in sketches :)
[18:07] < MS-> not kamaelia related - only a problem if you think it is
[18:07] < MS-> :)
[18:08] < mhrd-sometimes-a> the EIT generator can probably be kamaeliafied relatively easily
[18:08] < MS-> i personally don't since it could either be componentised or made into support code to make it easier to be reused
[18:08] < mhrd-sometimes-a> the playout scheduler is a mess and would take alot more engineering
[18:08] < mhrd-sometimes-a> sure
[18:09] < MS-> It's your call, but just saying it'd be really cool to see it available - I'm actually on planning on making something using your gesture recognition code now BTW
[18:09] < mhrd-sometimes-a> I noticed :) cool
[18:10] < MS-> So putting random stuff in sketches is a really good idea :)
[18:10] < mhrd-sometimes-a> noted :)
[18:10] < MS-> Specifically it's based on vmlemon's comment of a kamaelia based speak and spell
[18:10] < mhrd-sometimes-a> heh, v. cool :)
[18:10] < mhrd-sometimes-a> "write 'a' ... that is correct. now, write 'b' ..." :)
[18:10] < MS-> I figure a talking, handwriting recognising thing would be a really neat learning tool for reading, writing and spelling :)
[18:10] < MS-> absolutely :)
[18:11] < MS-> precisely what I'm thinking
[18:11] < MS-> the fact it's fussy is a real bonus
[18:11] < mhrd-sometimes-a> heh
[18:11] *** mhrd-sometimes-a ought to go ... cya
[18:11] < MS-> cya :)
[18:11] < mhrd-sometimes-a> < /advertising mashed>
[18:12] *** mhrd-sometimes-a is now known as mhrd-afk
[18:21] < j_baker> MS-: Will you get a moment today for our meeting?
[18:40] < MS-> sure
[18:43] < j_baker> Is right now good for you?
[18:44] < MS-> Maybe in about 1/2 hour or so
[18:45] < MS-> (often I'm "done" with early evening stuff before 8pm local, but not always)
[18:45] < MS-> Definitly before 9 local time
[18:45] < MS-> (it's ~19:50 for me btw)
[18:46] < j_baker> np... I should be here, so let me know when you're ready.
[19:28] *** vmlemon_ has joined #kamaelia
[20:33] *** mhrd-home has joined #kamaelia
[20:37] < mhrd-home> evening
[20:37] < MS-> evening
[20:47] < j_baker> Are we still doing the release on the 21st?
[20:48] < MS-> j_baker: I'm still planning that, yes. I'm going to declare it a beta release or release candidate rather than 0.6.0 final, but it'll be a release
[20:48] < MS-> I feel that hard deadlines tend to encourage me to focus
[20:48] < MS-> Problem is I have an unrelated deadline tomorrow, so won't be able to full focus on it until tomorrow
[20:48] *** Trun has joined #kamaelia
[20:49] < MS-> But I think there's more than enough already in, but will keep putting stuff in and packaging until we're done really
[20:49] < mhrd-home> cool
[20:49] < MS-> (and testing it for stability along the way naturally)
[20:49] < MS-> (last thing you want is to say to a large number of people "hey look at this cool stuff" and for it to fail when you show people :) )
[20:51] < j_baker> I've made a couple of changes to the HTTPServer based of private_MPS_Scratch. Do you think if I spun that off into a branch, there would be enough time to merge it before the 21st?
[20:51] < MS-> Let's try and see
[20:51] < MS-> :)
[20:52] < MS-> The only way to find out is to not say "no"
[20:53] < j_baker> Works for me. I'll also try to get the WsgiHandler in under Experimental. I've fixed most of what I wanted to accomplish with that. I just need to add some documentation, run some tests, and make a simple example.
[20:54] < mhrd-home> also cool
[20:54] < MS-> Under experimental is perfect
[20:55] < MS-> I'm probably going to move the gesture recognition stuff under Kamaelia.Apps since it's even more experimental, but useful.
[20:56] < MS-> (people will be naturally less likely to use something in an "Apps" location since they'll think "that's an internal thing" until it's been scavenged into the main tree)
[20:56] < mhrd-home> MS-: just ask if the 'grammar' and 'pattern' stuff doesn't make sense
[20:57] < MS-> I've had a look before at some of it and it at least vaguely made sense - but the nice thing is I should be able to use it relatively as a black box
[20:58] *** MS- is distracted by bsg at the moment
[20:58] < mhrd-home> you may need to be aware of the grammar stuff since thats what converts multiple consecutive strokes into a single letter (just warning :-) )
[20:58] < mhrd-home> aaah
[20:58] < MS-> (final ep before "mid season" break)
[20:58] < MS-> (which means "back in 2009" in practice)
[20:59] < MS-> Yep, I'd noted the grammar converts an "l" or "i" into a "t" :)
[21:06] *** MS- avoids spoilering matt now that's over
[21:08] < MS-> Sorry j_baker was rather distracted
[21:11] < MS-> If you're still there, I'd be interested in hearing how you're doing, what your current status is (though I have been following checkins etc), and what you're planning on immediately next & longer term
[21:12] < MS-> And if there's anything you need from me which I can help with or direct you to
[21:13] < j_baker> Well, the only thing I really want to do is make it so that my program can pull configuration data from the zipfile executable before I start doing more thorough testing.
[21:15] < j_baker> I would also like to daemonize the program and make it run in a similar fashion to mod_wsgi's "daemon mode" (ie, each program gets its own process), but those are probably further down the road (if they get done at all during GSOC).
[21:15] < j_baker> I did have a couple of questions though: 1) I remember you telling me that my wsgi.input environ variable could be vulnerable to a DOS attack (since it uses cStringIO). How would I solve that? Could I use a tempfile, or would that be worse?
[21:16] < j_baker> 2) Do you have any advice on what to do to test the program other than to try it with different WSGI apps and stress test it?
[21:16] < MS-> The DOS attack really revolves around "what happens if I post 10 1G videos at your server at once"
[21:17] < j_baker> Ah. So perhaps there should be a limit on the size of the memory file?
[21:17] < MS-> Using a tempfile would help offset that to an extent, but the correct approach is to just not read wsgi.input before you should. For the moment it's best to note it and then deal with it properly in the next version
[21:17] < MS-> You could do that as well, and note that as a limitation.
[21:18] < MS-> Regarding 2) I think that the approach you've described is the one I'd look at - since it's a practical approach. I'd also look for a compliance test suite, but fundamentally the only real test is against apps
[21:19] < MS-> I'd suggest 2 particular apps though as worth testing: Django & pylons
[21:19] < MS-> Both should run on top of WSGI and if they run, that should mean that it covers a wide set of problems
[21:19] < MS-> I'd pick the simplest possible apps for each though
[21:20] < j_baker> wsgiref has a validator, but I believe my code should already pass it.
[21:20] *** MS- nods
[21:21] < MS-> regarding stress testing, it's also worth bearing in mind that for personal sites the level of traffic you're likely to get is low per server
[21:21] < MS-> It could be more of an issue for your "intemediary" later on though
[21:22] < MS-> But one thing at a time, and at the moment, given the "make it work, make it work right, make it fast" rule of thumb, I'd suggest we're at stage 2
[21:22] < MS-> Since you still have open issues (that you've been raising)
[21:24] < j_baker> Ok. Is there also anything I should worry about security-wise? I know that my simple app is probably insecure as hell since it doesn't escape input, but that's more of a test than anything else.
[21:25] < MS-> I think at this stage no. What it may be worth doing is going through it and marking the parts that you think need reviewing and adding either
[21:25] < MS-> # FIXME: < ...>
[21:25] < MS-> or
[21:25] < MS-> # NOTE: < ...>
[21:25] < MS-> marks into there
[21:25] < MS-> since then it's easier to grep through the files to extract those things later on
[21:26] < MS-> and collate them for review
[21:27] < j_baker> Ok. I think that should be all the questions I have for now. If I think of any others, I'll post them to the list.
[21:27] *** MS- is writing a reply regarding your "ready for merge link"
[21:34] < j_baker> Hey, have you also been able to test my program out? I added a urls file that needs to be put in your home directory.
[21:36] < MS-> I haven't had a chance yet - I've really been swamped recently
[21:37] < MS-> (still am actually)
[21:37] < MS-> (which is a pain, but hey :) )
[21:37] < MS-> (that's life :) )
[21:37] < MS-> At minimum I should *definitely* be able to have a good look on sunday :)
[21:37] < j_baker> np... I'll make sure to put up installation instructions for when you do.
[21:38] < MS-> (which is a bit irritating for me - I'd prefer sooner)
[21:39] < j_baker> Hey, GSOC pays the bills for me, not you. It's understandable for you to have outside commitments.
[21:40] < MS-> cheers :)
[21:40] < MS-> Yeah, but I do actually *want* to get a chance to play with what you're doing
[21:41] < MS-> I'm hoping also (for example) to be able to host my current (day) work ontop of your work, primarily to see if I can move my work's hosted application off the server to client side
[21:41] < MS-> Whether or not that's useful for work is by the by (might well not be), but it would make a very nicer, very real test of your code - since it's a real app
[21:41] < MS-> :)
[21:42] < MS-> Much like your moinmoin test was a good one, since that's a real app
[21:42] < j_baker> That would be pretty interesting. I'd been thinking that there may also be uses for my code for business purposes too.
[21:42] < j_baker> I'll be giving MoinMoin another shot now that I SHOULD have POST methods fixed.
[21:44] < MS-> That's a good step forward.
[21:44] < MS-> My work code should be an interesting test in itself because I *am* posting video at the server.
[21:46] < j_baker> Heh... well, that will definitely be an optimization challenge when I get to that point. The handler is set up currently to wait for the body in its entirety before it starts working.
[21:49] < MS-> That's kinda what I'm aiming for really - the best way to get code working well is once it gets past the "working" and "right" stage is to keep throwing stuff at it that it gets progressively harder for it to keep going
[21:50] < j_baker> True. One thing that I did learn from the book they sent me: it's a good idea to attack the hardest problem first.
[21:51] < j_baker> (I believe that was in the chapter about deadlocks in the Solaris kernel)
[21:52] < MS-> It's one approach
[21:52] < MS-> Though sometimes that can lock you completely
[21:52] < MS-> In a way though, that's what kamaelia does address though "how do I make concurrency easy(or easier) to work with"
[21:53] < MS-> everything else kinda follows really from that
[21:53] < MS-> and things get simpler
[21:53] < MS-> It's a bit like tin openers as well
[21:53] < MS-> People used to make a particular kind which were difficult for most people to use, but worked OK
[21:54] < MS-> Then someone tried make some for people with weak hands (ie the harder problem)
[21:54] < MS-> That worked, and now that design is the more popular one because it works better for everyone
[21:54] < MS-> Applies in lots of domains
[21:55] < MS-> Sometimes though you attempt the intractable and just get demoralised and can't move forward - so accepting a partial solution to the hard problem is often a good idea initially
[21:55] < MS-> since you make progress
[21:55] < MS-> (all IMO)
[21:55] < j_baker> Indeed. I still laugh every time I hear a C++ zealot complain about how younguns these days can't do anything without a garbage collector.
[21:55] < j_baker> (regarding the tin opener thing)
[21:57] < MS-> The best C++ code I've seen tends to reuse someone elses garbage collector :)
[21:58] < j_baker> Using a garbage collector with C++ is almost like trying to put an engine on a bike IMO. It makes it go faster and easier, but the two just weren't made for each other.
[21:59] < j_baker> But I'm FAR from being a C++ guru.
[21:59] < MS-> Take a look at shedskin if you ever get the chance - it may change your views there
[21:59] < MS-> It's a python to C++ compiler
[21:59] < MS-> But it works really quite well
[21:59] < j_baker> Really? Interesting.
[22:00] < MS-> and that's the code that I'm thinking of that uses the GC
[22:00] < j_baker> I'm taking a very C++ intensive class next semester so that may help.
[22:00] < MS-> It may well do
[22:02] *** MS- goes afk
[22:03] < MS-> many thanks for keeping momentum up btw
[22:03] < MS-> it's very cool/good to see :)
[22:04] *** MS- is now known as ms-afk
[22:09] < j_baker> np... thanks for getting around to me with your busy schedule.
[22:11] < ms-afk> :)
[22:12] *** ms-afk gets back to work...
[22:12] < ms-afk> (I said I'd get something done by tomorrow, so .. hence .. well .. :)
[22:12] < ms-afk> )
[22:30] *** jlei_ has joined #kamaelia
[22:53] *** jlei_ has parted #kamaelia
[23:27] *** mhrd-home has parted #kamaelia