Questions tagged [cluster]

A group of computers acting as one super-computer.

Filter by
Sorted by
Tagged with
63
votes
6answers
40k views

How do I build a cluster?

There have been a few articles floating around online over the last few years about building a cluster of computers at home - here for example. The Pi strikes me as a good platform for building / ...
34
votes
1answer
63k views

Pros and Cons of a Pi Cluster?

I have seen a lot of posts asking how to build a "supercomputer" or cluster with Raspberry Pis, but I have found very little with the pros and cons of actually making a network of Pis. I am interested ...
13
votes
6answers
4k views

Raspberry Pi Cluster Computer

I have recently bought a Porta Pi Arcade, which is basically an RPi powered arcade machine running emulation station and retro pi. I am currently running mame, Sega genesis etc. Using the Pi 2 i have ...
6
votes
6answers
19k views

Does Raspberry Pi cluster make sense for a small rendering farm

I have seen bunch of articles saying how raspberries could be joined to make a cluster. I basically am a 3d artist type thing and you know rendering a 10 second animation can take hours. So if I make ...
5
votes
2answers
2k views

Can Compute Modules provide clustering and high availability?

I am very interested in Compute Modules, but have a few concerns: The main press release (linked above) for Compute Modules states that these systems are "primarily designed for those who are going ...
4
votes
4answers
8k views

Raspberry Pi for Machine Learning

I’m a software engineer interested (and doing research) in machine learning. For some of my machine learning models, I need more computational power than which offered by a single computer. Presently,...
4
votes
3answers
120 views

Raspberry Pi Cluster for Computation

I am new to Raspberry Pi's (as well as this stackexchange) and would like to use them to learn how to build a small cluster. (Currently using this guide: https://medium.com/@glmdev/building-a-...
4
votes
1answer
3k views

Is it possible to do GPU-accelerated tasks on a raspberry pi?

I have been looking into doing some cluster computing on several raspberry pis. Is it possible to use any kind of GPU acceleration on a pi?
4
votes
1answer
5k views

How to: build a graphics cluster

Currently, I am waiting for my second RPi to arrive and then I will begin my fun building a RPi cluster. Also, later I want to extend it more and more. =) I am building it at home, home-experiment, ...
4
votes
0answers
382 views

Is it possible to install Rocks Cluster Distribution on Raspberry Pi?

There are lots of websites about making a supercomputer with Raspberry Pi. Is it possible to install "Rocks Cluster Distribution" on Raspberry to have a more efficient cluster?
3
votes
2answers
6k views

NAS with a cluster of some raspberry pi

Is it possible to make a high performance NAS with a Raspberry Pi cluster (2 to 4 pis)? With high performance I mean able to handle streaming of 2 full HD movies at the same time. Let's say I have 4 ...
3
votes
2answers
199 views

Cost-effectiveness of Pi cluster

Does it make sense to use Pi cluster for real computation? My use case is to carry out intensive computation tasks 24/7. The tasks are pleasantly parallel, and there will be minimum inter-node ...
3
votes
0answers
308 views

Is it viable to run a cluster of Pis on PoE?

I’m thinking of experimenting with clustering RPis, but the thought of that mess of equipment (switch + multi-port USB charger) and cables is a bit of a turn-off. Does anyone know if there are any ...
2
votes
3answers
588 views

Combine 2 Raspberry Pi 3

Can i somehow combine 2 Pi's so i have a better CPU speed? I'm new to this so a link to some tutorials (if possible) would be nice I know you can create a cluster for a database so you can scale it, ...
2
votes
3answers
201 views

Clustering the 3.3v and 5v rails

Is it possible or advisable to connect the 3.3v or 5v rails of each Pi in a Pi cluster to other Pi's respective rails, so as to minimize loads across any one particular Pi's voltage rail? If it is ...
2
votes
2answers
1k views

largest raspberry pi cluster

To my knowledge the cluster built by GCHQs is the currently the largest one. Does anyone know of a larger cluster currently being created? I found a 300 Pi cluster being built by this group http://...
2
votes
3answers
12k views

Raspberry Pi cluster running as gaming server (TF2 modded minecraft)

I am new to raspberry pi and I am keen to play with its capabilities. I am a keen gamer as well and would like to see if I could link the two. I have been reading up on raspberry clusters and I would ...
2
votes
1answer
4k views

Minecraft server on raspberry pi cluster

Can i run a minecraft server on a cluster of 4 or 8 raspberry pis (model B+), and use all core and ram for the minecraft server?
2
votes
2answers
524 views

RPi cluster or a dual Xeon

I have a text processing project that is currently Bash, GNU Parallel and other command-line tools. It's getting moved to a C++ queue type design. It is about 14,000 files each day, plus performing ...
2
votes
2answers
714 views

Thermal Management in Raspberry Pi Clusters

I've been looking through several posts (on the internet) about building Raspberry Pi clusters- and my major question is something rather simple- what about the heat management? Would they overheat ...
2
votes
1answer
285 views

TensorFlow on a ClusterHat

Has anyone experience of running distributed AI on the Cluster Hat using Pi Zeroes? Specifically, can I run TensorFlow on a Cluster HAT ideally using the GPUs on the PiZeros as well as on the ...
2
votes
1answer
2k views

How to connect multiple Pi Zero ethernet gadgets to a Pi 2?

I followed this guide to turn my Raspberry Pi Zeroes into ethernet gadgets and I did not change anything in the /etc/network/interfaces or /etc/dhcpcd.conf files. All of the SD cards were fresh ...
1
vote
1answer
126 views

Can I just create a python thread per raspberry pi for parallel processing?

I have been looking to make a cluster of raspberry pi 4s, and have been pretty interested in it and made good head way. I have seen quite a few guides on the topic as well. I followed this one found ...
1
vote
2answers
534 views

Power multiple Pis through 5V GPIO and 5V wall wart

I'm considering making a Pi cluster (Let's say 8 Pi 3s), and instead of buying an 8-port USB charger and 8 USB cables of exactly the right length, could I use a powerful enough (8A?) 5V wall wart and ...
1
vote
3answers
2k views

Is it OK to install Jessie Lite on a Raspberry 1 model B?

My problems started when I used it as a master node in a cluster with 3 more Pi2B as slaves. Nfs4 did not run because of the portmap issue and then I could not install openjdk7 because of the packages ...
1
vote
3answers
509 views

Mult-head micro-usb cable

I am building a raspberry pi cluster. I am looking for a multi-head micro-usb power cable to power them. Does such a beast exist? Or can I make one myself?
1
vote
1answer
58 views

max number of Pi 3's to safely plug into a wall [duplicate]

This post is basically a repeat of: Is there a maximum number of Pis that I can power from the same wall socket? However my situation is slightly modified. Particularly for wall sockets in Denmark, ...
1
vote
1answer
544 views

Internal network between multiple RPis

Consider the following scenario where I have n number of RPis connected to a Ethernet switch in order to create a internal network. All these RPis have a static IP. Now one of the RPi (call it a ...
1
vote
1answer
972 views

Proper use of a rpi cluster

I have done a lot of reading about rpi clusters. Don't worry I am not going to ask if they function as a single virtual computer. I understand that they can be used to divide up complex tasks or ...
1
vote
1answer
37 views

Is my ClusterHat faulty or my RPi GPIO fried?

I've been using a ClusterHat (1RPi + 4 PiZeroes) and all has been well until recently. The PiZeros boot off the RPi's SD card using the ClusterHAT-2018-10-09-lite-1-usbboot boot image, and when I ...
1
vote
1answer
83 views

A way to connect M RaspiCams to N raspberry Pi Compute modules, where M>>N?

I am planning to set up camera rig, which will require 10+ cameras (preferred 20+ or "as many as possible" in spatial arrangement around the observed area. The setup will be academic, experimental, ...
1
vote
1answer
625 views

Pi Zero Cluster with Lan over Usb

I want to buy some Pi Zeros and build a cluster. I wanted to ask if i add an Ethernet port through a mini-USB to Usb OTG Adapter and a RJ45 Adapter, then the Pi Zero would function like the standard ...
1
vote
1answer
952 views

RetroPie with multiple Pi 3s

I currently have a Rasp Pi 3 Model B running RetroPie on Raspbian that is wiring well enough, it can play everything pre-N64 fairly well, and can get through many of the N64 games out there with ...
1
vote
1answer
89 views

Is there a maximum number of Pis that I can power from the same wall socket?

I'm trying to get an idea of how many pi's I can run at the same time from the same wall socket. I've done some research and it seems to me that the peak power consumption is somewhere around 750mA. ...
1
vote
1answer
927 views

Would it be possible you create a retropie cluster that would run the different processes on each individual pi? [duplicate]

Hi I'm kind of new to the whole raspberry pi thing and have been researching about retropie that allows you to emulate games on the pi. Anyway would it be possible to create a raspberry pi cluster ...
1
vote
1answer
5k views

How to check ipv6?

So, I'm building hadoop cluster with raspberry right now, I need to disable ipv6 connectivity, and need to know whether ipv6 has been disabled or not. In some guide cat /proc/sys/net/ipv6/conf/all/...
1
vote
1answer
1k views

Load Balancer vs. Master Node

I have been doing some research in building a Raspberry Pi cluster, and I have found 2 main approaches to the cluster configuration. The first I found, such as this report from the University of ...
1
vote
1answer
362 views

Unable to boot raspberry pi from copy of master

I am following the steps to build a cluster from Southampton uni "Steps to make Raspberry Pi Supercomputer" - step 32 and have got to the part where I make a copy of the SD card. The second Pi doesn'...
1
vote
0answers
16 views

API requests on standalone WIFI access point

After following this tutorial, I was able to create a standalone WIFI access point. Now, I would like to run a server I developed in C++ and do API requests from an App on my phone. Then, I would ...
1
vote
0answers
58 views

Can the Raspberry Pi cluster be used with Unreal Engine 4 to split up tasks and make it faster?

I am planning on building a raspberry pi cluster with my computer so can it be used to run UE4 faster and more efficiently on my computer than without the raspberry pi cluster(4 raspberry pi’s)?
1
vote
0answers
124 views

RPi 4 - 8 nodes - Appropriate switch for POE

I was thinking about an 8 port switch that can provide my 8 RPi's 4 power over POE. I think i have found one according to my needs ( small dimensions), namely the: Ubiquiti EdgeSwitch 10XP - https://...
1
vote
0answers
147 views

PI2/3 Cluster with Hass.io (Home Assistant)

I have a Raspberry PI Cluster (1 master PI/2, 2 workers PI/3) with Raspbian, Docker, Kubernetes installed. I have no volumes defined (OpenEBS seems not officially supported yet). I initialized helm ...
1
vote
0answers
63 views

Raspberry Pi Cluster Computing With MPI

So I have followed this tutorial on how to make a Raspberry PI cluster computer. It works great, I can parallel my processes with MPI, but I'm also wondering if this is possible. Currently, all four ...
1
vote
0answers
61 views

Technologies to use in a peer to peer, file sync, high availability, cluster like, backup solution [closed]

I've been doing research on how to setup a self host backup high availability solution using raspberry pi's. The biggest requirement is master to master replication and cross platform client support. ...
1
vote
0answers
40 views

Duplicate output in MPIEXEC

I have installed MPI on my 3 node raspberry-pi 3B+ cluster and whenever I run any command I get 12 replies, 4 from each node, as an example, when I run mpirun -machinefile machine-file hostname I get ...
1
vote
1answer
759 views

Raspberry Pi 3 Cluster

I was looking to make a Raspberry Pi 3 cluster just for the fun of it and for learning a bit about how clusters work. From my research I have seen that the cluster concept follows 1 machine which is ...
1
vote
0answers
374 views

Crosscompiling with distcc on Raspberry Pi Cluster

I wanted to make a cluster of Raspberry Pi's for distributed compiling (C++), so I started with just one Pi for testing. After installing distcc on my PC and the Pi and configuring them the compiler ...
1
vote
0answers
92 views

Bluetoothctl scan response in cluster setup

I have a raspberry Pi cluster with 4 nodes. I wanted to run bluetoothctl in the master node and receive just the scan response in other three nodes in the cluster. Please help me how to do this. ...
1
vote
0answers
347 views

VPS on clustered Pi

Can I setup VPS on a clustered RPi? I think Raspbian takes only about a 100mb of RAM, so there's plenty of space left to 'virtual'ize another set of simple OS, but I'm not sure how. Any suggestions ...
1
vote
2answers
201 views

SSH and rsa authentication on mpich2

I'm trying to build a small cluster of pi's and am using mpich2 to run parallel code. It appears mpich2 has installed ok and I'm able to ssh into both (I'm starting with 2) pi's. However when I run a ...