I like to see the little sister on the B station? Python crawler helps you automatically download cover

Hello everyone, welcome to Crossin’s programming classroom!

Bilibili, that is, commonly known as B station, I believe everyone is not strange. What video do you like to see on the B station? Chasing, gaming, funny video, or intellectual area? Of course, there is also a small sister in the dance area.

A development case to share today is: How to climb the video cover of B station small sister with Python

Note: This article is only discussed as programming technology, and the relevant code and data are not available for commercial purposes, otherwise the consequences are at your own risk.

Page analysis

Open the Bilibili search "small sister":

There is a total of 5 pages, take Page 2 as an example, F12 opens the web source code:

About the use of the F12 tool, you can refer to our previous article:

Search the first Title, we can find the corresponding XHR request, carefully analyze all the data exists in a JSON format, and our goals are in the Result list.

Check if Headers is as follows:

This is a GET request, requiring two items and keywords corresponding to the request.

View more pages to find the rules:

You can see that in addition to page 1, there is only one page parameter in the URL in other pages. So we try to request the URL of other pages in the first page, and the result will find the result that can be wanted (yourself Try).

Conclusion: All pages URL only Page parameters are different, and others are consistent.

2. Data crawling

2.1 Import Module

2.2 Get page information

Request data according to the URL of the analysis:

2.3 Get concrete picture information

The code parses the video title, time, playback, release time, author, picture link, etc. Here we take the title and picture link, other parameters can be increased, delete as needed.

2.4 Save Pictures

Here we use the title as the picture name to store, you need to note that the file name cannot contain four species, here is "/,. |" And other four types (a daily video is displayed, there may be entry, you need to adjust yourself, you can also use the title Make a name).

3. Result

Some pictures:

Individual car transport to achieve the lowest cost, cloud drive grapefruit freight vehicle logistics modern wisdom with AI

Intelligent ongoing transformation of traditional industries, the shipping industry, especially the development of intelligence in the field of vehicle logistics is still early.

Specifically, vehicle logistics field current lower overall level of trust, both ends of the dispersion of supply and demand is high, difficult to enhance efficiency, high cost and pricing opaque markets such as widespread pain points, need to intervene with the penetration of digital means.

According to the prospectus disclosure of full help group, in 2020 China car freight market size of about 3.76 trillion yuan, and vehicle logistics industry completed a total of intercity transportation orders of about 997 million, the market size is very impressive. This also meansArtificial intelligence, big data technology vehicle logistics reform drive has enough space for development.

Entrepreneurship recent state contact "cloud grapefruit freight" roots in logistics and transport industry, has erected a new generation of digital vehicle logistics management system, to provide one-stop transportation services for the owner of the cargo terminal at the end of the car by the scheduling algorithm, path planning algorithms to provide efficient and cost optimal combination of orders and route planning for the owners.

At present, the company has developed to B2 round, won from BlueRun, Tencent investment, tens of millions of dollars financing Pentatomic capital, tripods and investment, joy and capital letter and a number of venture capital institutions days, many of the old shareholders continuous investment rounds.

As a set of logistics and transportation technology-enabled in an enterprise,Starting point cloud grapefruit shipments to solve the problem within the logistics industry volumeTo help cargo fleet, lowering the efficiency of individual owners in the plight of the intense competition in the industry to maintain a certain profit margin.

As one of the most intuitive example, in 2021, the annual income level of domestic individual drivers compared with last year dropped by nearly 40 percent, and even lower compared to a decade ago, the entire population of great pressure to survive.

Cloud grapefruit freight founder & CEO Zhou Jilong said: "Cloud technology from grapefruit freight started, hoping to help the freight transport industry practitioners who improve this dilemma has been achievedSingle average net increase operating efficiency of the vehicle and 60% -70%. "

Specific solutions, cloud grapefruit freight was first established with standardized pricing, the ability to send a single self-employed capacity,Erected "AI-driven intelligence team". The adoption of flexible distributed cloud computing architecture for large-scale data analysis in real time, using intelligent real-time scheduling, dynamic bidding strategy, Shortest Path and many other key technologies, will transport the whole process of digitization.

Logistics for loading a typical scene, path planning, vehicle scheduling and other issues, grapefruit cloud freight also developed a multi-fusion algorithms, machine learning, and operations research support "smart logistics center of the brain," can help drivers plan in the actual scene They may face the national highway and winding road selection, gas stations and other selection strategy.

Up to now, the cost of a single cloud-km circuit grapefruit freight import car, the monthly number of valid travel mileage and so on a number of parameters significantly better than skilled individual vehicle level.

After the "AI-driven wisdom of the team" business maturity, cloud grapefruit freight capacity by social organizations to establish a logistics service platform, the ability of the algorithm to enhance the efficiency of the drive assigned to give both ends of Logistics market.

At the supply end,Cloud grapefruit has connected hundreds of thousands of individual vehicles, Led by technology trade transportation, and use the "lowest transport costs between any two points," the decision algorithm enabling the individual owners; the demand side, the cloud grapefruit are all kinds of self-development of algorithms and tools package, to form a standard module and Foreign open to help logistics companies to improve efficiency in terms of cost savings drop, vehicle management, financial management, and further the development of logistics business.

Cloud grapefruit freight team, said: "The essence of the logistics industry is to go on time and space, in fact, intelligent transformation of the vehicle in time to fight, we are in the middle of the stitching down time, let’s try to spend less time parked vehicle, and more Take the time to run on the road. before the cloud grapefruit incoming cargo, the car industry may be 60% of the time parked 40% of the time in transit, and we have now put this ratio upside down. "

It is understood that cloud grapefruit existing freight orders rose five times over the past three months, a larger number of users increases, the cloud platform touch of grapefruit freight drivers have hundreds of thousands of individuals, the owner of the enterprise nearly thousand, from social vehicles the business accounted for a larger proportion of revenue.

The company is now the main business model is to charge a commission to the owner, the next plan to open up more business-like way.

In terms of the team, grapefruit cloud freight existing staff of 300 people, including a larger proportion of R & D and strategy team, the company’s core team members come from Peking University, Zurich Federal Institute of Technology, Sichuan University and other famous universities at home and abroad, has served on McKinsey, gold and other enterprises.

From the general direction point of view, cloud grapefruit freight do is intelligent transformation of traditional industries, currently serves upgrade the stock market, the future incremental mainly from two aspects: First, there will be what percentage of logistics scene turned intelligent, Second, the process of turning the stock in intelligence, improved efficiency will also bring incremental benefits to society as a whole.

Zhou Jilong said: "China’s road transport market increment can be expected, intensive, standardization, a clear trend has been well received intelligence of the national strategic level attention, and new infrastructure with two-cycle strategy also promote the development of ‘artificial intelligence + logistics’ of cloud grapefruit freight picked the right track, but also the long-term roots in this circuit. "

Future, cloud grapefruit freight will continue to strengthen product development capabilities and subscriber growth, and strive to order volume, the number of owners and the owner of the connection and then lifted up an order of magnitude. The company will also continue to enhance the ability of algorithms and sensors detect the level of the supply density, density of the order when the platform reaches a certain level, we will consider the incoming carpool track.

The three major paths boost the city to implement the "double carbon" goal! Artificial intelligence

Recently, the National Industrial Information Safety Development Research Center and Baidu Intelligent Cloud Comnthetic "Artificial Intelligence City" Double Carbon "Target Rendenerability Rendenever." The white paper is based on the "double carbon" strategy, combing the connotation and key areas of the city’s "double carbon" target, analyzing the path of the "double carbon" target of artificial intelligence city and the exploration practice of major cities, and proposed corresponding The initiative suggestion is to provide reference to the maximum effectiveness of manual intelligence, driving urban green low-carbon development.

White paper pointed out that artificial intelligence as a strategic technology that led the new round of technology revolutions and industrial change, accelerating integration with economic and social development, and gradually became an important means to help the city’s "double carbon" goals.

White paper mentioned that artificial intelligence mainly passed the three major paths to help the city to implement the "double carbon" goal: one is to help reduce its own carbon emissions, use deep learning algorithms, open source platforms, etc., reduce artificial intelligence technology itself in the data center, model development Carbon emissions; second, the second is to monitor urban carbon emissions, through intelligent sensors are closely perceived, satellite remote sensing distance observation, using artificial intelligent monitoring platform to integrated urban carbon emissions, can realize tracking, learning, simulation of carbon footprints, etc. Effectively help urban predictions and optimize carbon emissions; third is the key area of ??"double carbon" in the city, promote carbon emission reduction through three dimensions of key industries, urban governance, and public life, through promoting low-carbon circulation and carbon transactions Market construction increases carbon absorption, realizing carbon neutralization.

The white paper also mentioned that many cities have now actively explored in terms of artificial intelligence cities "double carbon" goals, and have achieved certain results, but the future still needs further development: to build digital bases, strengthen new foundations The green low-carbon orientation of the facility; to find the carbon home, play the role of artificial intelligence in "double carbon" target management; to simulate carbon footprint, use artificial intelligent solution to optimize carbon emission path; to empower new scenes, explore practice New model of "double carbon" strategy in the city; to build a "double carbon" platform, promote new technologies such as artificial intelligence to achieve "double carbon" goals.

According to disclosed reports, my country has announced to the world that it strives to achieve carbon-up peaks 2030, and 2060 years ago. The "Double Carbon" goal has fully reflected the responsibility and responsibility of China as an international big country, and it will also force my country’s energy consumption transformation, and the industrial upgrading has brought energy consumption in the form of energy consumption.

Bitcoin inches closer to becoming legal tender globally

SAN SALVADOR: El Salvador on Tuesday becomes the first country in the world to accept bitcoin as legal tender, despite widespread domestic skepticism and international warnings of risks for consumers.

President Nayib Bukele’s government claims the move will give many Salvadorans access to bank services for the first time and save some $400 million in fees on remittances sent home from abroad every year.

“Tomorrow, for the first time in history, all the eyes of the world will be on El Salvador. #Bitcoin did this,” Bukele said on Twitter Monday.

He started the ball rolling Monday evening by announcing El Salvador had bought its first 400 bitcoins, in two tranches of 200, and promised more were coming.

The 400 bitcoins were trading at around $21 million, according to the cryptocurrency exchange app Gemini.

Recent opinion polls showed a majority of El Salvador’s 6.5 million people reject the idea and will continue using the US dollar, the country’s legal currency for the last 20 years.

“This bitcoin is a currency that does not exist, a currency that will not benefit the poor but the rich,” said skeptic Jose Santos Melara, who took part in a protest by several hundred people in the capital San Salvador last week.

“How will a poor person invest (in bitcoin) if they barely have enough to eat?”

In June, El Salvador’s parliament approved a law to allow the crypto money to be accepted as tender for all goods and services in the small Central American nation, along with the US dollar.

The bill, an initiative of Bukele, was approved within 24 hours of being presented to Congress — where the president’s allies have held a majority since March.

Experts and regulators have highlighted concerns about the cryptocurrency’s notorious volatility and the lack of any protections for its users.

– Skepticism –

The government is installing more than 200 bitcoin teller machines, some guarded by soldiers to prevent possible arson by opponents.

And Bukele has promised $30 for each citizen who adopts the currency.

“These are decisions the administration and lawmakers have taken without consulting” the population, said Laura Andrade, director of the Public Opinion Institute of the Central American University, which found in a poll that 70 percent of Salvadorans opposed the move.

“We see that people do not perceive a positive impact to significantly transform their living conditions,” she told AFP.

Nearly two-thirds of Salvadorans questioned for the poll said they had no interest in downloading the “Chivo” electronic wallet that will allow users to buy and spend bitcoin.

Oscar Cabrera, an economist at the University of El Salvador, said the currency’s high volatility will have a “negative impact” on consumers, affecting the price of goods and services.

The currency fell beneath $30,000 in June, less than half its all-time high of more than $64,000 just two months earlier.

For its part, the Salvadoran Foundation for Economic and Social Development (FUSADE) said it was “unconstitutional” to make it compulsory for merchants to accept bitcoin as a form of payment.

– ‘Malign actors’ –

Bukele, who is popular but under fire in several quarters for moves to tighten his grip on power, has accused opponents of seeking to “sow fear” among Salvadorans, few of whom have access to formal banking services.

Remittances account for more than a fifth of GDP in the dollarized economy, mainly sent in dollars via agencies such as Western Union by an estimated 1.5 million expats.

According to World Bank data, El Salvador received more than $5.9 billion in 2020 from nationals living abroad, mainly in the United States.

And the country is relying on this money to boost a struggling economy that contracted 7.9 percent in 2020 due in large part to the coronavirus pandemic.

Economists and international bodies such as the World Bank, International Monetary Fund and Inter-American Development Bank have expressed concerns about El Salvador’s bitcoin adoption.

The United States has urged El Salvador to ensure a “regulated,” “transparent” and “responsible” use of bitcoin, and to protect itself from “malign actors” such as hackers seeking ransom money.

Bitcoin is criticized by regulators for its potential for illegal use — notably in laundering money from criminal activities and financing terrorism.

But not everyone is against it, and according to Bukele in late June, some 50,000 Salvadorans were using bitcoin.

Many of them are in the coastal town of El Zonte, where hundreds of businesses and individuals use the currency for everything from paying utilities bills to buying a can of soda.

Started as a project by an anonymous bitcoin donor, the town until recently boasted El Salvador’s only bitcoin teller machine.