What programming language allows for multithreading on a Unix box?

[Angry Jew Cat - Banned for Life]

I'm under the impression that PHP is not the way to go as it doesn't support real multithreading. So what language does and will run smoothly on a unix/linux server?

[Kiopa_Matt]

Perl. Google for Perl fork() examples.

And you're right, PHP doesn't support multi-threading.

PS. What do you need multi-threading for? Correct me if I'm wrong, but assuming you're a novice developer, you're going to want to put your head through a wall several times while trying to write a multi-threaded Perl application. Maybe it's not needed? What are doing?

[k0nr4d]

http://php.net/manual/en/book.pcntl.php you can use this to fake multithreading in php...

[Brujah]

php has more than adequate multithreaded support if you're doing scraping or fetching, so it depends what you're doing. python may also be a good candidate for your needs.

[Angry Jew Cat - Banned for Life]

I'm not touching this shit with a 10 foot pole, but I want to know what type of developer I want to be looking for. Will be fetching/scraping a large amount of data from multiple sources for SEO research. Needs to support a large proxy list and multi-threading to accomplish my goals. Will probably need to perform between 180-250k requests daily...

[Brujah]

I know a great multithreaded perl coder if you need one. He specializes in data mining. I know how to do this stuff, and I still use him myself.

[Angry Jew Cat - Banned for Life]

I know a great multithreaded perl coder if you need one. He specializes in data mining. I know how to do this stuff, and I still use him myself.

You could just sell me your clickmojo script and cut through 90% of the shit... lol

[Brujah]

You could just sell me your clickmojo script and cut through 90% of the shit... lol

lol just join the site and use the scanner!

[Angry Jew Cat - Banned for Life]

lol just join the site and use the scanner!

That come with resell rights? I'm sure it would be 1000% easier to just scrape your results...

[jay23]

http://en.wikipedia.org/wiki/Erlang_...ng_language%29

but this may be over kill for what you want to do .

If you are looking for the best programming language to code multithreading apps on a Unix box nothing comes close to Erlang

[nation-x]

A java console application would also work but you could also use php and curl

http://php.net/manual/en/function.curl-multi-exec.php

[GrouchyAdmin]

Suggesting PCNTL use to someone who isn't familiar is like handing a 3 year old a Maserati, the keys, and a wrench. No good can come of this.

You can fork off several copies/etc, but seeing that you want to multiplex proxies and stuff.. nah, can't help ya man.

[v0id]

node.js http://nodejs.org/

[blogman9]

Java .

[Lassitor]

Perl or Python would be my first choice. What exactly are you doing on the unix box?

[WarChild]

PHP is a scripting language, not really a programming language.

Why do you need to use a Unix box? This is a job for C# or VB

[Angry Jew Cat - Banned for Life]

PHP is a scripting language, not really a programming language.

Why do you need to use a Unix box? This is a job for C# or VB

I'm assuming that this will be a resource hog necessitating it's own box, so Windows is an option, and it was something I had been considering as another alternative.

[beta-tester]

Python all the way

[woj]

just about any language will work, unless you are building the next google, which you probably aren't...

[WarChild]

I'm assuming that this will be a resource hog necessitating it's own box, so Windows is an option, and it was something I had been considering as another alternative.

I program in Windows. You won't really need a very big box. Since you're going to use direct http post and get you should be okay. It's not like you'll be running hundreds of conncurent instances of IE.

The submit box that runs my custom tube submitter software literally submits to hundreds of tube sites at the same time and it's nothing special.

[WarChild]

Depending on the complexity of the scraping and warehousing requirments, I don't think it would take that long to do.

Personally I'd start with a third party component like Chilkat HTTP library which has built in proxing support and makes working with http uber simple.

You could easily house it on a webair $99 unmanaged windows server with 10mbit included bandwidth. SQL Server license is another $40 a month or something like that.

[Angry Jew Cat - Banned for Life]

Depending on the complexity of the scraping and warehousing requirments, I don't think it would take that long to do.

Personally I'd start with a third party component like Chilkat HTTP library which has built in proxing support and makes working with http uber simple.

You could easily house it on a webair $99 unmanaged windows server with 10mbit included bandwidth. SQL Server license is another $40 a month or something like that.

A lot of the data can be pulled from XML feeds and via a couple different APIs. I'm still researching my options for a while yet. I want to be sure I come at this from the right angle this first time. Windows is sounding like a good option. If it ever comes down to it, I could always run the software locally for my own use.

[HarryMuff]

Java .

This ^. Unless u suck.

[HarryMuff]

PHP is a scripting language, not really a programming language.

Why do you need to use a Unix box? This is a job for C# or VB

Sure you could use C#, but he has unix, might as well use Java, which is what C# copied.

[GrouchyAdmin]

Sure you could use C#, but he has unix, might as well use Java, which is what C# copied.

Copied all the way down to being a resource hog and providing very little core functionality.

[fris]

python would be your best bet

[HarryMuff]

Copied all the way down to being a resource hog and providing very little core functionality.

Well that's it then, I'm going to do everything in assembly language from now on.