How to browse bmp files on Flipper.

Hi All,
I am noob in all sorts of electronics. I just managed to flash ESP32-CAM module with proper firmware after quadrillion tries. It works just fine. Ultra cool that thing is. How do you guys browse those tiny .bmp files on Flipper Zero? I know I can download them to phone or computer but it would be really cool to display them on Flipper display. Any help much appreciated.

Thank you! You can find the images in the "DCIM" folder at the root of your SD card. You can do that directly or by using the qFlipper app: https://github.com/flipperdevices/qFlipper
Hope that helps

Thank you! You can find the images in the "DCIM" folder at the root of your SD card. You can do that directly or by using the qFlipper app: https://github.com/flipperdevices/qFlipper
Hope that helps

Thank you for your reply. I can find the images but there is no possibility to view then directly on Flipper. This is why I submitted request of new feature:
https://github.com/CodyTolene/Flipper-Zero-Camera-Suite/issues/55
Thank you.


Renaming label ends up deleting all labels with the replacement label target

  - source_labels: [exported_job]
    regex: '.*/(.*)'
    replacement: '$1'
    target_label: job

This breaks ALL existing labels called job, making them dissapearing.

Not sure I understand what your problem is. Can you be more concrete?


Support in-language translations for emails/texts with applicants

Describe the bug
We send applicants an email when they apply but it is always in English and not their preferred language
https://sourcegraph.com/github.com/civiform/civiform/-/blob/server/app/services/applicant/ApplicantService.java?L416:64&subtree=true

Related to #4850.


[HOTFIX] Fix spark version mismatch

What is this PR for?
Trivial fix for version mismatch in pom file.
What type of PR is it?
[Hot Fix]
Todos

[ ] - Task

What is the Jira issue?

No jira

How should this be tested?

CI pass

Screenshots (if appropriate)
Questions:

Does the licenses files need update? No
Is there breaking changes for older versions? No
Does this needs documentation? No

another interpreters have a version 0.9.0-SNAPSHOT, what problem to update?

@masyan Which version do you mean ? This PR is for branch-0.8, it is correct if you see 0.9-SNAPSHOT in master branch.

For some reason I thought to the master. LGTM


Base64 images get truncated using AgentExecutor with create_openai_tools_agent

Checked other resources

[X] I added a very descriptive title to this issue.
[X] I searched the LangChain documentation with the integrated search.
[X] I used the GitHub search to find a similar question and didn't find it.
[X] I am sure that this is a bug in LangChain rather than my code.
[X] The bug is not resolved by updating to the latest stable version of LangChain (or the specific integration package).

Example Code
import base64
from io import BytesIO
import requests

from PIL import Image
from langchain.tools import tool
from langchain_openai import ChatOpenAI
from langchain.agents import create_openai_tools_agent, AgentExecutor
from langchain_core.messages import SystemMessage
from langchain_core.prompts import ChatPromptTemplate, HumanMessagePromptTemplate, MessagesPlaceholder

@tool
def download_image(url:str,
                   local_save_path:str="/home/victor/Desktop/image_llm.jpeg") -> str:

    """Downloads and returns an image given a url as parameter"""

    try:
        # Send a HTTP request to the URL
        response = requests.get(url, stream=True)
        # Check if the request was successful
        response.raise_for_status()

        img_content = response.content
        image_stream = BytesIO(img_content)
        pil_image = Image.open(image_stream)
        pil_image.save(local_save_path)
        buffered = BytesIO()
        pil_image.save(buffered, format='JPEG', quality=85)
        base64_image = base64.b64encode(buffered.getvalue()).decode()
        src = f"data:image/jpeg;base64,{base64_image}"
        print(len(src))
        return src

    except requests.HTTPError as http_err:
        print(f"HTTP error occurred: {http_err}")
    except Exception as err:
        print(f"An error occurred: {err}")

tools = [download_image]

llm = ChatOpenAI(temperature=0,
                             model='gpt-4-turbo',
                             api_key='YOUR_API_KEY)

template_messages = [SystemMessage(content="You are helpful assistante"),
                     MessagesPlaceholder(variable_name='chat_history', optional=True),
                     HumanMessagePromptTemplate.from_template("{user_input}"),
                     MessagesPlaceholder(variable_name='agent_scratchpad')]
prompt = ChatPromptTemplate.from_messages(template_messages)

agent = create_openai_tools_agent(llm, tools, prompt)
agent_executor = AgentExecutor(agent=agent,
                               tools=tools,
                               verbose=True,
                               max_iterations=3)
def ask_agent(user_input,
              chat_history,
              agent_executor):

    agent_response = agent_executor.invoke({"user_input": user_input, "chat_history": chat_history})
    print(len(agent_response["output"]))
    return agent_response["output"]

if __name__ == '__main__':

    user_input = "Please show the following image: https://upload.wikimedia.org/wikipedia/commons/1/1e/Demonstrations_in_Victoria6.jpg"
    chat_history = []
    agent_response = ask_agent(user_input,
                               chat_history,
                               agent_executor)

Error Message and Stack Trace (if applicable)
No response
Description
I am building a chat langchain agent powered by openai models. The agent is part of the backend of a web app that has a frontend where the user can interact with the agent.
The goal of this agent is to do some tool calling when the user message requires to do so. Some of the tools require to download images and send them to frontend so the user can visualize them. This process is done by encoding the images with base64, so that they are displayed correctly to the user.
The problem I am facing is that base64 image gets truncated when the agent finishes the chain and returns the answer. As an example, the base64 image that is downloaded by download_image has a length of 54443, while the answer returned by the agent has a length of 5762. This means that the image gets truncated by the agent. I am not completely sure why this happens, but maybe it is related with the maximum number of tokens that the agent can handle.
Some alternatives that I have tried, but failed to make this work:

Reduce the image size: the image gets truncated anyway
Reduce the image quality: the image gets truncated anyway
Try do divide the image in chunks: works fine, but after I ask the agent to reassemble the chunks, it gets truncated.
Reduce the max_iteration  parameter in AgentExecutor but the problems persists

I guess I could get into more low level stuff and try to override some default configuration of the agent, but first I wanted to ask for help to solve this problem.
System Info
langchain==0.1.20
langchain-community==0.0.38
langchain-core==0.1.52
langchain-openai==0.1.6
langchain-text-splitters==0.0.1
platform:
Distributor ID:	Ubuntu
Description:	Ubuntu 20.04.6 LTS
Release:	20.04
Codename:	focal
Python 3.8.10

I am having the same issue using the following code:
const prompt = await pull<ChatPromptTemplate>(
  'hwchase17/openai-tools-agent',
)

const llm = new ChatOpenAI({
  model: 'gpt-4o',
  temperature: 0,
  apiKey: process.env.OPENAPI_KEY,
})

const agent = createToolCallingAgent({
  llm,
  tools,
  // streamRunnable: true,
  prompt,
})

const agentExecutor = new AgentExecutor({
  agent,
  tools,
  // returnIntermediateSteps: true,
  // verbose: true,
})

const input = `...`

console.log(`input length: ${input.length}`);

const result = await agentExecutor.stream(
  { input },
  { maxConcurrency: 100 }
)

The input length is in my example: 43046 characters and the output gets truncated after around 20500 characters (sometimes more sometimes less, e.g. 20389, 21373 or 20443`). Any feedback would be appreciated.


Failed to load in kibana 5.2.1

Expected Behavior

I want to run chart.js on kibana
Current Behavior

Hello,
we are developing kibana plugins.
kibana 5.2.1
include node.js 6.9.5
Angularjs 1.4.7
we plan to use chart.js as library on kibana.
However, an error occurs when starting up node.js and startup is not completed.
Description of load processing(Chart.js) part.

var chartjs = Private(require('plugins/circle-vis/chartjs/Chart'));

error message from kibana

Mar 15 20:49:53 localhost kibana: {"type":"log","timestamp":"2017-03-15T11:49:53Z","tags":["info","optimize"],"pid":3875,"message":"Optimizing and caching bundles for kibana, timelion and status_page. This may take a few minutes"}
Mar 15 20:50:58 localhost kibana: {"type":"log","@timestamp":"2017-03-15T11:50:58Z","tags":["fatal"],"pid":3875,"level":"fatal","message":"Optimizations failure.\n\n ERROR in /usr/share/kibana/plugins/circle-vis/public/chartjs/Chart.js\n Module build failed: TypeError: /usr/share/kibana/plugins/circle-vis/public/chartjs/Chart.js: name.toLowerCase is not a function\n at check (/usr/share/kibana/node_modules/babel-core/lib/transformation/transformers/validation/react.js:20:22)\n at NodePath.CallExpression (/usr/share/kibana/node_modules/babel-core/lib/transformation/transformers/validation/react.js:40:7)\n at NodePath.call (/usr/share/kibana/node_modules/babel-core/lib/traversal/path/context.js:56:28)\n at NodePath.visit (/usr/share/kibana/node_modules/babel-core/lib/traversal/path/context.js:90:8)\n at TraversalContext.visitSingle (/usr/share/kibana/node_modules/babel-core/lib/traversal/context.js:132:12)\n at TraversalContext.visit (/usr/share/kibana/node_modules/babel-core/lib/traversal/context.js:148:19)\n at Function.traverse.node (/usr/share/kibana/node_modules/babel-core/lib/traversal/index.js:76:17)\n at NodePath.visit (/usr/share/kibana/node_modules/babel-core/lib/traversal/path/context.js:107:26)\n at TraversalContext.visitMultiple (/usr/share/kibana/node_modules/babel-core/lib/traversal/context.js:108:16)\n at TraversalContext.visit (/usr/share/kibana/node_modules/babel-core/lib/traversal/context.js:146:19)\n at Function.traverse.node (/usr/share/kibana/node_modules/babel-core/lib/traversal/index.js:76:17)\n at NodePath.visit (/usr/share/kibana/node_modules/babel-core/lib/traversal/path/context.js:107:26)\n at TraversalContext.visitMultiple (/usr/share/kibana/node_modules/babel-core/lib/traversal/context.js:108:16)\n at TraversalContext.visit (/usr/share/kibana/node_modules/babel-core/lib/traversal/context.js:146:19)\n at Function.traverse.node (/usr/share/kibana/node_modules/babel-core/lib/traversal/index.js:76:17)\n at
Mar 15 20:50:58 localhost kibana: NodePath.visit (/usr/share/kibana/node_modules/babel-core/lib/traversal/path/context.js:107:26)\n /usr/share/kibana/plugins/circle-vis/public/circle_vis_controller.js 13:26-69\n","error":{"message":"Optimizations failure.\n\n \u001b[1m\u001b[31mERROR in /usr/share/kibana/plugins/circle-vis/public/chartjs/Chart.js\n Module build failed: TypeError: /usr/share/kibana/plugins/circle-vis/public/chartjs/Chart.js: name.toLowerCase is not a function\n at check (/usr/share/kibana/node_modules/babel-core/lib/transformation/transformers/validation/react.js:20:22)\n at NodePath.CallExpression (/usr/share/kibana/node_modules/babel-core/lib/transformation/transformers/validation/react.js:40:7)\n at NodePath.call (/usr/share/kibana/node_modules/babel-core/lib/traversal/path/context.js:56:28)\n at NodePath.visit (/usr/share/kibana/node_modules/babel-core/lib/traversal/path/context.js:90:8)\n at TraversalContext.visitSingle (/usr/share/kibana/node_modules/babel-core/lib/traversal/context.js:132:12)\n at TraversalContext.visit (/usr/share/kibana/node_modules/babel-core/lib/traversal/context.js:148:19)\n at Function.traverse.node (/usr/share/kibana/node_modules/babel-core/lib/traversal/index.js:76:17)\n at NodePath.visit (/usr/share/kibana/node_modules/babel-core/lib/traversal/path/context.js:107:26)\n at TraversalContext.visitMultiple (/usr/share/kibana/node_modules/babel-core/lib/traversal/context.js:108:16)\n at TraversalContext.visit (/usr/share/kibana/node_modules/babel-core/lib/traversal/context.js:146:19)\n at Function.traverse.node (/usr/share/kibana/node_modules/babel-core/lib/traversal/index.js:76:17)\n at NodePath.visit (/usr/share/kibana/node_modules/babel-core/lib/traversal/path/context.js:107:26)\n at TraversalContext.visitMultiple (/usr/share/kibana/node_modules/babel-core/lib/traversal/context.js:108:16)\n at TraversalContext.visit (/usr/share/kibana/node_modules/babel-core/lib/traversal/context.js:146:19)\n

It seems that the specified file can be read, but it gets an error.
There is no change in the situation even if you downgrade chart.js
Could you give me some advice?
Possible Solution

Steps to Reproduce (for bugs)

make a kibana plugin
load a chart.js in kibana (ex. Private(require('plugins/circle-vis/chartjs/Chart')) )
started kibana (ex. systemctl start kibana)

Context

I want to run chart.js on kibana plugin.
Environment

Chart.js version: 2.5.0
Browser name and version: chrome 56.0.2924.87
Link to your project:

Based on the call stack it looks like toLowerCase does not exist. We don't use toLowerCase at all in our code (I grepped the entire src directory). What does your kibana plugin look like?

Thank you !!.
As for toLowerCase, it was confirmed that it is not used with grep.
For plugin I created, it is recognized by deleting the problem part.

var chartjs = Private(require('plugins/circle-vis/chartjs/Chart'));

I am happy if I have some experience...

Hmmm, is plugins/circle-vis/chartjs/Chart pointing directly to the Chart.js file or is it pointing to a wrapper?

Thank you !!.
I'm trying to load it directly.
Directory configuration is as follows

/usr/share/kibana/plugins/circle-vis/public/circle_vis.less
/usr/share/kibana/plugins/circle-vis/public/circle_vis_params.html
/usr/share/kibana/plugins/circle-vis/public/circle_vis.html
/usr/share/kibana/plugins/circle-vis/public/circle_vis.js
/usr/share/kibana/plugins/circle-vis/public/circle_vis_controller.js
/usr/share/kibana/plugins/circle-vis/public/chartjs
/usr/share/kibana/plugins/circle-vis/public/chartjs/Chart.js
/usr/share/kibana/plugins/circle-vis/package.json
/usr/share/kibana/plugins/circle-vis/index.js

Download chart.js from https://github.com/chartjs/Chart.js/releases/download/v2.5.0/Chart.js
source code of circle_vis_controller.js
define(function (require) {
  var _ = require('lodash');

  var module = require('ui/modules').get('kibana/circle-vis', ['kibana']);

  module.controller('circleVisController', function ($scope, Private) {

    var tabifyAggResponse = Private(require('ui/agg_response/tabify/tabify'));
    var chartjs = Private(require('plugins/circle-vis/chartjs/Chart'));

    $scope.$watch('esResponse', function (resp) {
      if (resp) {
        console.log('esResponse');
        console.log(resp);
      }
    });
  });
});

I'm not sure what the issue is here. I tried looking through the babel-core codebase to get some hints but found nothing. I would report this issue to the maintainers of Kibana and see if you get anything from them.

Closing since this does not appear to be a Chart.js issue

After all, I gave up load of bundled js.
Succeeded by loading src / chart.js.
It is roughly as follows.

Install with npm
$ npm install chart.js
install chart.js in the plugin directory using npm

Write to controller

var chart = require('chart.js')
...
var myChart = new Chart(...)

Thank you for your efforts.


Kotlin 1.7 compatibility

Feature Description
Hi we are running our stack on Kotlin 1.7, is it possible to build against 1.7 and publish in Maven repo along with 1.9?
Problem it Solves
Compatibility with Kotlin 1.7
Proposed Solution
Publish dependencies for Kotlin 1.7
Additional Context
Add any other context, examples, or references that might help illustrate the feature or its benefits.

Hey @dmeshkov-brex, I appreciate the suggestion regarding Kotlin 1.7 compatibility. I understand where you're coming from. I'll look into it, but I'm a bit concerned about the maintainability of supporting both 1.7 and 1.9

migrated to 1.9 and finally integrated the library. Thanks!!


TCP port mapping on ports used for ssh goes wrong

TCP port mappings using the ports used for ssh mapping can go wrong.

Steps to reproduce:

Create 1 env with 1 container running on nat'ed peer:

Create port mappings

ssh -p 10004<EMAIL_ADDRESS>is working
ssh -p 10003<EMAIL_ADDRESS>is not working

This may be relevant:

And yes - this is obvious!!!!  Two scenarios:

Peer with public IP

No problems at all

Peer behind nat

Port mappings need to be made on a proxy peer.  Connection FROM proxy peer TO peer goes through the same p2p mechanism as SSH connections from client and so get caught by the same rule that is used for ssh.
Consider this port mappng:

Everything works except the last one (container-7 is using port 10008 for ssh)

The final (10008) one goes: lth@ncpws04:~$ telnet p1.envs.subut.ai 10008 Trying <IP_ADDRESS>... Connected to p1.envs.subut.ai. Escape character is '^]'. SSH-2.0-OpenSSH_7.4p1 Debian-10+deb9u3


[Usage]: How to use vllm infer video with Internvl2 8b multimodal model

Your current environment
python==3.8
vllm==0.5.4
transformers==4.44.0
torch==2.4.0
How would you like to use vllm
I want to run inference of a Internvl2 8b with video source. I don't know how to integrate it with vllm.
Before submitting a new issue...

[X] Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

It's not supported yet, but will be soon! See https://github.com/vllm-project/vllm/pull/6514#issuecomment-2328535852

In general, it might be nice to have a snippet showing how to infer with a model (supporting videos) on an input video.

InternVL2 now supports multi-image input. As is the case with the HF repo, for video input you should first convert it into a sequence of image frames. You can check out the examples in this script.


Make comment editor expandable

The editor in the comment widget doesn't get any larger when the content doesn't fit. This makes editing long comments painful:

Duplicate of  #110403


Missing any in -emit-silgen output

protocol P {
  associatedtype T
}

func foo(_: any P) {}

-emit-silgen outputs this:
sil_stage raw

import Builtin
import Swift
import SwiftShims

protocol P {
  associatedtype T
}

func foo(_: P)

sil [ossa] @main : $@convention(c) (Int32, UnsafeMutablePointer<Optional<UnsafeMutablePointer<Int8>>>) -> Int32 {
...

Which doesn't parse back in because of the missing any.

Ah, printing any is currently gated behind PrintOptions::PrintExplicitAny, which is only set to true for diagnostics and Swift interface printing. I think it's time to print any everywhere! I've been procrastinating this because I tried it once and like 300 tests failed 😂

@hborla Want me to do this? 😂

@AnthonyLatsis that is very nice of you! But don't worry I'm already 178 test files in 🙂


Resetting Password breakes with HTTP 500

When trying to reset a password with a valid registered email adress one receives HTTP 500. In the following the Request and Respons headers from Google Chrome in Inkognito mode (I removed my email adress for privacy reasons) cockies and so on should not be a problem.
I was able to reproduce the problem also without inkognito mode. I don't know about other browsers but I would be sure 500 is always a serversided problem (:
Request URL:https://de.serlo.org/auth/password/restore
Request Method:POST
Status Code:500
Remote Address:<IP_ADDRESS>:443
Referrer Policy:no-referrer-when-downgrade
Response Headers
age:0
alt-svc:clear
cache-control:no-store, no-cache, must-revalidate
cf-ray:3a826b7cdfd62732-FRA
content-security-policy:default-src https: 'unsafe-inline' 'unsafe-eval'; font-src: 'unsafe-inline' 'unsafe-eval' ; script-src https: www.google-analytics.com ajax.googleapis.com 'unsafe-inline' 'unsafe-eval'; img-src * data:
content-type:text/html; charset=UTF-8
date:Tue, 03 Oct 2017 19:48:36 GMT
expires:Thu, 19 Nov 1981 08:52:00 GMT
pragma:no-cache
server:cloudflare-nginx
status:500
strict-transport-security:max-age=15552000; includeSubDomains
via:1.1 google
via:1.1 varnish-v4, 1.1 google
x-cacheable:NO:TTL is 0
x-content-type-options:nosniff
x-frame-options:SAMEORIGIN
x-stroker-cache:Miss
x-varnish:7720808
x-varnish-cache:MISSED
x-xss-protection:1; mode=block
Request Headers
:authority:de.serlo.org
:method:POST
:path:/auth/password/restore
:scheme:https
accept:text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,/*;q=0.8
accept-encoding:gzip, deflate, br
accept-language:de,en-US;q=0.8,en;q=0.6
cache-control:max-age=0
content-length:83
content-type:application/x-www-form-urlencoded
cookie:__cfduid=db2dc4f4f3ce5973db9478cf8f86ba6f41507060089; PHPSESSID=9g372d45mjn5l9ajr53jk0d1s3; _gat=1; _hjIncludedInSample=1; _ga=GA1.2.93485145.1507060091; _gid=GA1.2.1900394137.1507060091; _gali=select-user
origin:https://de.serlo.org
referer:https://de.serlo.org/auth/password/restore
upgrade-insecure-requests:1
user-agent:Mozilla/5.0 (X11; CrOS armv7l 9592.85.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3112.112 Safari/537.36
Form Data
view source
view URL encoded
csrf:e9ff262b35ce41f74ca7b92f53240cfe
email: REMOVED FOR PRIVACY RESONS
submit:Restore

The error is caused by our new 2FA policy which accidentally included the account sending out notifications, thank you for the report, I'll try to fix it asap.

This has now been resolved. However, you will not receive a success flasher on serlo.org itself, but you will receive an email notification. This is currently caused by issue #477


[FLINK-34200][test] Fix the bug that AutoRescalingITCase.testCheckpointRescalingInKeyedState fails occasionally

Backporting FLINK-34200 to 1.19

The CI failure is due to another issue which is documented in FLINK-34411

@flinkbot run azure


Add HTTP probing support

This PR adds support for HTTP probing. It provides an API based on httptrace callbacks.
Current list of configurable options:

URL
Method
Headers
Body
Timeout
CallFrequency (aka target RPS)
MaxConcurrentCalls (aka number of call workers)

Available callbacks:

OnReq
OnResp
OnDNSStart
OnDNSDone
OnConnStart
OnConnDone
OnTLSStart
OnTLSDone
OnWroteHeaders
OnFirstByReceived

Misc config:

Custom http client
Logger

Basic usage example
httpCaller := probing.NewHttpCaller("https://www.google.com",
    probing.WithHTTPCallerCallFrequency(time.Second),
    probing.WithHTTPCallerOnResp(func(suite *probing.TraceSuite, info *probing.HTTPCallInfo) {
        fmt.Printf("got resp, status code: %d, latency: %s\n",
            info.StatusCode,
            suite.GetGeneralEnd().Sub(suite.GetGeneralStart()),
        )
    }),
)

// Listen for Ctrl-C.
c := make(chan os.Signal, 1)
signal.Notify(c, os.Interrupt)
go func() {
    <-c
    httpCaller.Stop()
}()
httpCaller.Run()

Based on issue: https://github.com/prometheus-community/pro-bing/issues/88

CC: @davinci26


Bump a version from master to 0.3.0

Please bump a pod spec version to newest one.

Hi @m1entus, there is at least two interesting PRs hanging, I hope me and @oarrabi will review and merge them and release new version after that.

@m1entus 0.3.0 is live (it does not include your PR, I'm making final preparations to release 1.0.0 version since it would have minor but breaking change
https://github.com/oarrabi/OAStackView/issues/51


fix: do not run GH Action on fork #4537

Fixes Issue
fixes #4537

Changes proposed

Check List (Check all the applicable boxes)

[ ] My code follows the code style of this project.
[ ] My change requires changes to the documentation.
[ ] I have updated the documentation accordingly.
[ ] All new and existing tests passed.
[ ] This PR does not contain plagiarized content.
[ ] The title of my pull request is a short description of the requested changes.

Screenshots

Note to reviewers

Thanks all 👍

Like an option to disable all actions on forks by default.

yep 👍  maybe one day


Set shell as bash for files/tests/nagios_killall

This this script uses bash specific syntax, the
shell should be set as bash explicitly
to ensure that even if it is invoked as a
regular executable that it will run as expected.
This commit also adds set -e to ensure that the script
does not proceed if any of it fails.

resolves #721 /cc @hkumarmk

please test this

Test PASSed

@hkumarmk this resolves the issue that you pointed out, can you please have a look? It's already passed integration tests.

tests passed, looks good, merging.


Check file type based on buffer instead of extension

So right now the I guess it only check for file type based on its extension, do you plan to add support for it?
This is quite an edge cases but simple to implement using file-type library.

Hi, right now the file check is done via mime type which is given by busboy

good idea to check the file type via a magic number, we should add some validation decorators. thanks for idea

Ah my own decorator use file-type to check the buffer, I can rewrite it to use busboy then I'll submit a PR

I have already started the implementation, there will be a new version soon with built-in decorators to check file extensions via file-type. It will check the type via incoming stream from busboy, this will improve version backward compatibility. I also added some tests for this

I'm looking forward to it 🙂
And thank you for the awesome library!

Hi, version 1.8.0 has been released!
Please check new version and change log

Hi @dmitriy-nz, I ran tests in my projects with the new version and it looks good
Thank you!


JdbcAggregationRepository build error by spring JtaTransactionManager

JdbcAggregationRepository requires  org.springframework.transaction.jta.JtaTransactionManager;
The spring requires spring-text. So when build the app, it will show an error
Caused by: java.lang.NoClassDefFoundError: org/springframework/jndi/JndiTemplate
 JdbcAggregationRepository aggregationRepository = new JdbcAggregationRepository(
                new JtaTransactionManager(userTransaction, tm), "aggregation", dataSource);

.aggregate(constant(true),new MyAggregationStrategy()).completionSize(5).aggregationRepository(aggregationRepository)

This error is happening in native building ? I think we have a integration test with JdbcAggregationRepository and please check it with https://github.com/apache/camel-quarkus/blob/main/integration-tests/sql/src/main/java/org/apache/camel/quarkus/component/sql/it/SqlRoutes.java
Also you should depend on camel-quarkus-sql and camel-quarkus-jta.

@neoxu999 I am missing the reproducer. One option would be to modify the integration test in https://github.com/apache/camel-quarkus/blob/main/integration-tests/sql so that it fails due to your issue. Alternatively, you could attach a self-contained reproducer - a ZIP file with a Maven project or a a git repository URL containing a reproducer project.

Hi @zhfeng , I tried native and JVM. Both didn't work with JdbcAggregationRepository
By the way, there is another issue with native "mvn clean package -Dnative"
No instances of java.net.SocksSocketImpl are allowed in the image heap as this class should be initialized at image runtime. To see how this object got instantiated use --trace-object-instantiation=java.net.SocksSocketImpl.
It complains the class SocksSocketImpl. I looks like related to camel-quarkus-jta. For this kind build issue, do you have any suggestion please?

Hi @ppalaga , thanks for the suggestion. I will download the source code and try it.

Thanks @neoxu999 and it seems that you open a socket for listening at the build time which is not allowed in the native mode. Anyway, as @ppalaga mentioned, it would be very helpful for providing a reproducer for us. We can take a further look at the issue.

problem fixed by latest version. Thanks, @zhfeng , @ppalaga .

You are welcome and thanks for reporting anyway!


tiglWingComponentSegmentGetSegmentIntersection return error

In some cases, the function tiglWingComponentSegmentGetSegmentIntersection returns an error, even if everything seems okay.

The commit fixes both errors reported by Carsten Liersch on 27.02.2015 and 05.03.2015.


404 and around

If I create a plugin that serves a page when I request site/fakepage, for example using onPageRendering with $twigTemplate = 'fakepage.twig', Pico still considers this as 404 content. On the user side, everything works fine, but is404Content() returns true (similarly, on404ContentLoaded(&$rawContent) is also triggered). Is there a way to work around this? For instance, if I want to log all the requests that result in a 404, calls to site/fakepage would also be logged as 404s, but they shouldn't be.
Another question about 404 behavior: If I create a 404.md page and point to mysite/404, Pico serves the 404 page, but with a 200 OK response, because the page actually exists.  Is it an expected behavior? A better practice would be to only allow a _404.md file, which is not accessible directly but is used by Pico to serve a 404 message when there is a bad request. This approach, like before, avoids false positives when plugins check for  is404Content().

If I create a plugin that serves a page when I request site/fakepage, for example using onPageRendering with $twigTemplate = 'fakepage.twig', Pico still considers this as 404 content. […] Is there a way to work around this?

I'm afraid there isn't. There were plans for Pico 4.0 to fix that (by adding "virtual pages"), but that never materialized. Since your plugin is taking control anyway, you don't really have to care about is404Content() yielding true; the only effect it has is that you have to change the HTTP status code back to 200 OK.

Another question about 404 behavior: If I create a 404.md page and point to mysite/404, Pico serves the 404 page, but with a 200 OK response, because the page actually exists. Is it an expected behavior?

No, 404.md files are considered hidden and should therefore follow the is404Content path. Please check again (because the code looks right to me) and if Pico truly responds with 200 OK (check that no plugin is changing the status code!) please open a separate issue. However, as a disclaimer, since Pico's development has stopped, it's unlikely that it will be fixed.

I'm afraid there isn't. There were plans for Pico 4.0 to fix that (by adding "virtual pages"), but that never materialized.

Ok, thanks.


Made button optional in the settings page

Only show edit button when edit link and edit title are defined, making the button optional for when you just want to display some info.

Summary by CodeRabbit

New Features

Enhanced flexibility in the settings module by allowing editButtonTitle and editLink to accept null values, improving the handling of absent values.

Improvements

Refined conditional rendering logic to ensure buttons are displayed only when both editButtonTitle and editLink are present, enhancing component responsiveness.

@LouisDeconinck thanks! will merge once checks pass.


Found no platform_util.h under  mbedtls (IDFGH-2406)

尝试编译Hello World
提示
G:/ESP_IDF/esp-idf/components/mbedtls/port/esp32/aes.c:30:10: fatal error: mbedtls/platform_util.h: No such file or directory
#include "mbedtls/platform_util.h"
^~~~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
在 espressif/mbedtls 仓下没有找到 platform_util,h 疑惑
Running ninja in directory g:\esp_idf\esp-idf\examples\get-started\hello_world\build
Executing "ninja all"...
[94/851] Building C object esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir///port/esp32/aes.c.obj
FAILED: esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir///port/esp32/aes.c.obj
ccache D:\APP\espressif\tools\xtensa-esp32-elf\esp-2019r2-8.2.0\xtensa-esp32-elf\bin\xtensa-esp32-elf-gcc.exe -DMBEDTLS_CONFIG_FILE="
mbedtls/esp_config.h" -Iconfig -I../../../../components/mbedtls/port/include -I../../../../components/mbedtls/mbedtls/include -I../..
/../../components/newlib/platform_include -I../../../../components/freertos/include -I../../../../components/heap/include -I../../../.
./components/log/include -I../../../../components/soc/esp32/include -I../../../../components/soc/include -I../../../../components/esp_
rom/include -I../../../../components/esp_common/include -I../../../../components/xtensa/include -I../../../../components/xtensa/esp32/
include -I../../../../components/esp32/include -I../../../../components/driver/include -I../../../../components/esp_ringbuf/include -I
../../../../components/esp_event/include -I../../../../components/esp_netif/include -I../../../../components/lwip/include/apps -I../..
/../../components/lwip/include/apps/sntp -I../../../../components/lwip/lwip/src/include -I../../../../components/lwip/port/esp32/inclu
de -I../../../../components/lwip/port/esp32/include/arch -I../../../../components/vfs/include -I../../../../components/esp_wifi/includ
e -I../../../../components/esp_wifi/esp32/include -I../../../../components/esp_eth/include -I../../../../components/tcpip_adapter/incl
ude -I../../../../components/efuse/include -I../../../../components/efuse/esp32/include -I../../../../components/app_trace/include -ml
ongcalls -Wno-frame-address -Wall -Wextra -W -Wdeclaration-after-statement -Wwrite-strings -Wlogical-op -Wshadow -Wmissing-declaration
s -Wmissing-prototypes   -ffunction-sections -fdata-sections -fstrict-volatile-bitfields -nostdlib -Wall -Werror=all -Wno-error=unused
-function -Wno-error=unused-but-set-variable -Wno-error=unused-variable -Wno-error=deprecated-declarations -Wextra -Wno-unused-paramet
er -Wno-sign-compare -ggdb -Og -std=gnu99 -Wno-old-style-declaration -D_GNU_SOURCE -DIDF_VER="v4.1-dev-1086-g93a8603c5-dirty" -DGCC_
NOT_5_2_0 -DESP_PLATFORM -MD -MT esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir///port/esp32/aes.c.obj -MF esp-idf\mbed
tls\mbedtls\library\CMakeFiles\mbedcrypto.dir__\port\esp32\aes.c.obj.d -o esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.di
r///port/esp32/aes.c.obj   -c G:/ESP_IDF/esp-idf/components/mbedtls/port/esp32/aes.c
G:/ESP_IDF/esp-idf/components/mbedtls/port/esp32/aes.c:30:10: fatal error: mbedtls/platform_util.h: No such file or directory
#include "mbedtls/platform_util.h"
^~~~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
[107/851] Building C object esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedtls.dir/ssl_srv.c.obj
ninja: build stopped: subcommand failed.
ninja failed with exit code 1

@ElliottSeer Thanks for reporting the issue. Would you please help provide more details as suggested in the issue template? Information like elf, sdk configuration, backtrace, log outputs, commit ID, hardware and etc. would help us debug further. Thanks.

@ElliottSeer Did you update mbedtls submodule pointer? Here is file path for quick reference, https://github.com/espressif/mbedtls/blob/mbedtls-2.16.2-idf/include/mbedtls/platform_util.h

@ElliottSeer Did you update mbedtls submodule pointer? Here is file path for quick reference, https://github.com/espressif/mbedtls/blob/mbedtls-2.16.2-idf/include/mbedtls/platform_util.h

Yes, I did update mbedtls in wrong branch. I have to git clone every dependence myself due to the bad network environment in China. Could you build another repository on gitee? So developers in China can access esp idf more convenient.


Docs: Example usage of mesheryctl perf

Current State:
The Meshery docs are missing example usage of mesheryctl perf.
Desired State:
Considering the deceiving user experience of being able to reach a given endpoint (service) from a user's local machine, but Meshery (running on a bridge network) not being able to reach that same endpoint (when referenced as localhost or some other unreachable name/network), the mesheryctl user guide should contain example uses.
Related Issues:

#724

Contributor Resources

Meshery documentation site
Meshery documentation source
Instructions for contributing to documentation

@leecalcote sir, this issue is already addressed and needs to be closed

Good call, @ashis. You’re right.


vNext Proposal: Change public enum suffix.

Does this affect the legacy HoloToolkit (master) or the Mixed Reality Toolkit (mrtk_release)?
Mixed Reality Toolkit
Is your feature request related to a problem? Please describe.
The current naming convention for public enums (suffix Type) should change. Not everything an enum enumerates can or should be considered a 'type.' For instance:
 AppModeEnum.Initializing
 SessionStateEnum.InProgress

becomes:
AppModeType.Initializing
SessionStateType.InProgress

These are clumsy and redundant. A 'type' of mode or a type of state is just a mode or state.
Describe the solution you'd like
I'd love to eliminate the suffix for enums altogether, but Enum works. It's content-neutral and it helps discoverability.
Since this would be a breaking change it's something we'd want to do before vNext exits beta.

I think we've already agreed to this naming convention.

I figured now would be an ideal time to re-open the subject since we don't have a lot else on our plate.

Agreed "Type" is already the enum suffix as per the standards guide.
If there are instances that are not following this, then yes, they should be tidied up.  Do you have some specific examples where this is not being followed @Railboy ?

Most of the agreement around the "Type" suffix was a lot of "I'm ok either way, I guess Type works fine." I was among those answers.
However this example compels me to change my opinion to "Yeah, Enum is better, but it's not a big deal":

AppModeType.Initializing
SessionStateType.InProgress

Maybe we should remove the enum guidance from the style guide and leave it to individual judgement? It almost seems like the value of the enum guidance is less than the maintenance of debating the enum guidance.

 I think the fact that we have a suffix actually serves a functional purpose when it comes to declaring names of fields and properties in the class based off the enum type.


Add overridable visual interpolation

Time skewing works pretty well up to about 200 ping, but there's still a case to be made for optionally allowing manual control over how objects are visually interpolated from previous frames if they differ too much.

Done. It's called getObserved and it can optionally use interpolateFrom defined on TObjects.


added azure region module

Added module for azure regions

LGTM. Nice. Have you tested this?

I have not; I assume I can deploy to vercel from my branch? I have the main branch testing URL

@stirby, you can test by using the source URL of the form,
source = "git::https://github.com/<USERNAME>/<REPO>.git//<FOLDER>?ref=<BRANCH>"
Which in your case will be
source = "git::https://github.com/coder/modules.git//azure-region?ref=steve-regions"

@matifali Thank you for the help.
Tested, fixed the issues.


Database Schema

Users:
user_name - string
email? - string (unique)
password? - string
(password_digest with bcrypt gem secure_password)
Advice:
needs - integer
wants - integer
savings - integer
total_income - integer
recommendation - text or string?

LMK what you all think.

Looks good. I already added bcrypt gem. I don't think we need password column and just password digest. Recommendation should be text since its going to be over 254 characters.


Publish new ILD package version

@omeshp,
Thanks for your contribution as a Microsoft full-time employee or intern. You do not need to sign a CLA.
Thanks,
Microsoft Pull Request Bot


Use Mobile Services to Create UI

Tutorial URL: https://developers.sap.com/tutorials/cp-apim-sales-tracker-create-ui.html
Please specify the step you are referring to
Today in step 4 query parameters in Mobile services defined in other tap(URLs)

Tutorial corrected as per new UI and changes are pushed to QA.

Thanks, Shilpa.
вт, 16 апр. 2019 г., 19:07 Shilpa Vij<EMAIL_ADDRESS>
Tutorial corrected as per new UI and changes are pushed to QA.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/SAPDocuments/Tutorials/issues/3332#issuecomment-483632071,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AZtZHXZfS3A6ItjTAl_M9RVDvZiwRsenks5vhbzrgaJpZM4cjzOj
.

Thank you for your feedback. The issue seems to be resolved, so I am closing the issue.
If you still have questions, feel free to reopen the issue.


Landscape mode

@RamyTalal is there an option for a landscape mode? Thanks!

I think it's the Rotate command (not entirely sure). https://github.com/RamyTalal/Label-Printer/blob/master/src/Command/Rotate.php

@RamyTalal thanks! It worked but the settings on character sizes, alignments, etc. were ignored.

@ubay25 I think you have to set the orientation first then apply your format settings.
Give that a shot.

Just reading the ESC/P Command Reference...
Description

Using this command clears all text.
Before entering text, specify the paper orientation with this command.
When the printer is turned on, the landscape orientation is canceled.

@ubay25 See @ntaylor-86's comment. I'll close this issue for now.


Mofidy API group && upgrade API version

issue: https://github.com/rancher/harvester/issues/651

Modify API group from harvester.cattle.io to harvesterhci.io.
Upgrade API version from v1alpha1 to v1beta1.
Delete unused field stopOnce of monitor.Monitor structure.

let's use the similar library naming standard of the Harvester repo for better maintenance purpose, thanks


GROOVY-7549, GROOVY-9847: getOuterClass, getOuterClasses and getOuterField must check redirect

https://issues.apache.org/jira/browse/GROOVY-9847
https://issues.apache.org/jira/browse/GROOVY-7549
This also applies to 2_4_X but should already be present in 3_0_X and newer.

Merged into GROOVY_2_5_X. Please feel free to close.


GetBodyFunction Inner Function Scope Fix

Codecov Report

Merging #155 into master will increase coverage by 0.01%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           master     #155      +/-   ##
==========================================
+ Coverage   62.69%   62.71%   +0.01%
==========================================
  Files         100      100
  Lines        9520     9523       +3
==========================================
+ Hits         5969     5972       +3
  Misses       2911     2911
  Partials      640      640

Impacted Files
Coverage Δ

wrp/wrphttp/fanout.go
100% <100%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update eb0e57d...9aeb115. Read the comment docs.


Forge create parse tuple error

Component
Forge
Have you ensured that all of these are up to date?

[X] Foundry
[X] Foundryup

What version of Foundry are you on?
nightly-70d00222c2ef74fc484b8d98c5705d131ab31871
What command(s) is the bug in?
forge create --private-key $key --constructor_args "array of tuples" --rpc-url $url $contract
Operating System
Linux
Describe the bug
Trying to use forge create to deploy a contract onto a local network through rpc-url. Was working previously, and now without changes to the contract or other parts of the PR, getting following error in CI. The contract being deployed takes in an array of structs, and our script passes in array of tuple like so "[(struct element1, fields separated by commas)]".
local_network_test    | The application panicked (crashed).
local_network_test    | Message:  Could not parse types: TypeParser(Error("invalid type string: tuple"))
local_network_test    | Location: crates/forge/bin/cmd/create.rs:332
local_network_test    |
local_network_test    | This is a bug. Consider reporting it at https://github.com/foundry-rs/foundry
local_network_test    |
local_network_test    | Backtrace omitted. Run with RUST_BACKTRACE=1 environment variable to display it.
local_network_test    | Run with RUST_BACKTRACE=full to include source snippets.

thanks for flagging, looking into it


Load checkpoints from cloud storage

Added support to load checkpoints stored in object storage (rather than just on the local disk) and from URLs. Closes #192.

Refactored the run directory uploader to separate out object store related utilities to composer.utils.object_store (and added test coverage).
Updated the checkpointer loader and hparams to support checkpoints stored in URLs and in object stores. Chunk sizing and whether to show tqdm bars are hparams.
Refactored how ddp checkpoints are loaded and stored to avoid an os.listdir
Updated the checkpoint loader
Updated the Trainer.__init__ to propagate through this change.

Going to re-open this PR once #199  is merged in and this PR is rebased on top of it.

I've tested this and it works! Great job Ravi!


Fix more warnings in math_brute_force

This should unblock #1477

Fix "‘nadj’ may be used uninitialized in this function [-Werror=maybe-uninitialized]".

Fix "specified bound 4096 equals destination size [-Werror=stringop-truncation]".

Signed-off-by: Sven van Haastregt<EMAIL_ADDRESS>

Merged quickly to unblock PR #1477.


Show exact date instead of time

Description
It would be good if the log showed the exact date instead of the time it happened.
Proposed Behaviour
Screenshot:

Extra Details
No response

Hovering your cursor over the time since the log's recording already displays the date & time as shown in #3597

it's a fairly recent change, make sure you have luckperms updated. https://luckperms.net/download


Correction for raw affiliation King's College War Studies Department and the Sciences PO Medialab.

Correction needed for raw affiliation King's College War Studies Department and the Sciences PO Medialab.
raw_affiliation_name: King's College War Studies Department and the Sciences PO Medialab.
new_rors: 051j50p12;05fe7ax82
previous_rors: 051j50p12;044nptt90
works_examples: W2588724628
contact: 438c91850d3ccc5ff0168fe20c975d25:40bdcbca4f9ec4db7f54a0ca382a79e5a304aefcfb @ recherche.gouv.fr

This issue was accepted and ingested by the OpenAlex team on 2024-12-19. The new affiliations should be visible within the next 7 days.


tests: arch: arm: move test arm_thread_swap_tz to new ztest API

Migrate the testsuite tests/arch/arm/arm_thread_swap_tz to the
new ztest API.
Signed-off-by: Shaoan Li<EMAIL_ADDRESS>

Test build fails on the following platforms and has nothing to do with the new ztest API :
stm32l562e_dk_ns
nrf9160dk_nrf9160_ns
nucleo_l552ze_q_ns
nrf5340dk_nrf5340_cpuapp_ns
bl5340_dvk_cpuapp_ns
lpcxpresso55s69_ns
b_u585i_iot02a_ns

Likely related to https://github.com/zephyrproject-rtos/zephyr/pull/45906


Twitter Search Client Broken

Describe the bug
The TwitterSearchClient comes broken out of box
Error engaging with search terms: TypeError: Cannot read properties of undefined (reading 'id')
    at TwitterSearchClient.fetchHomeTimeline (file:///Users/owen.wahlgren/code/eliza/packages/client-twitter/dist/index.js:337:82)
    at TwitterSearchClient.engageWithSearchTerms (file:///Users/owen.wahlgren/code/eliza/packages/client-twitter/dist/index.js:812:45)

To Reproduce
Clone most recent release
Build character.json with twitter in character files clients array.
 "clients": [
    "twitter",
    "telegram"
  ],

Update packages/client-twitter/src/index.ts to include search functionality
import { TwitterPostClient } from "./post.ts";
import { TwitterSearchClient } from "./search.ts";
import { TwitterInteractionClient } from "./interactions.ts";
import { IAgentRuntime, Client, elizaLogger } from "@ai16z/eliza";
import { validateTwitterConfig } from "./environment.ts";
import { ClientBase } from "./base.ts";

class TwitterManager {
    client: ClientBase;
    post: TwitterPostClient;
    search: TwitterSearchClient;
    interaction: TwitterInteractionClient;
    constructor(runtime: IAgentRuntime) {
        this.client = new ClientBase(runtime);
        this.post = new TwitterPostClient(this.client, runtime);
        this.search = new TwitterSearchClient(runtime); // don't start the search client by default (ADDED THIS)
        // this searches topics from character file, but kind of violates consent of random users
        // burns your rate limit and can get your account banned
        // use at your own risk
        this.interaction = new TwitterInteractionClient(this.client, runtime);
    }
}

export const TwitterClientInterface: Client = {
    async start(runtime: IAgentRuntime) {
        await validateTwitterConfig(runtime);

        elizaLogger.log("Twitter client started");

        const manager = new TwitterManager(runtime);

        await manager.client.init();

        await manager.post.start();

        await manager.interaction.start();

        await manager.search.onReady(); // (ADDED THIS)

        return manager;
    },
    async stop(_runtime: IAgentRuntime) {
        elizaLogger.warn("Twitter client does not support stopping yet");
    },
};

export default TwitterClientInterface;

Build and start project:
pnpm build

pnpm start

Expected behavior
Should engage in searched timeline activity outside of just mentions

I also received "runtime.getSetting is not defined" when uncommenting and adding onReady to start the client on startup  and uncommenting
Tried fixing by updating createAgent and AgentRuntime, but ended up breaking the entire thing and won't launch.

I also received "runtime.getSetting is not defined" when uncommenting and adding onReady to start the client on startup and uncommenting
Tried fixing by updating createAgent and AgentRuntime, but ended up breaking the entire thing and won't launch.

I resolved this in packages/client-twitter/src/search.ts
 constructor(runtime: IAgentRuntime) {
        // Initialize the client and pass an optional callback to be called when the client is ready
        super(
            runtime, // change this
        );
    }

tbh this may be resolved if you bump to latest version of https://github.com/ai16z/agent-twitter-client
testing now

You've helped me overcome that roadblock, much appreciated! Now I see the search, but hitting:
Error engaging with search terms: TypeError: Cannot read properties of undefined (reading 'id')
    at TwitterSearchClient.fetchHomeTimeline (file:///root/eliza/packages/client-twitter/dist/index.js:311:82)
    at TwitterSearchClient.engageWithSearchTerms (file:///root/eliza/packages/client-twitter/dist/index.js:563:45)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)

Possibly unrelated to this, but will keep testing

here is my initial fix:
https://github.com/ai16z/eliza/commit/d0d062b46de7d639e5ec6d165ae5f2bd37f0b201
this will twitter search topics in character.json and reply to one on eliza's startup,
I don't think it is properly looping though, still working on it.
if I make substantial progress maybe we can make a PR

PR here:
https://github.com/ai16z/eliza/pull/951
make sure you have model set in character.json
"modelProvider": "openai",
  "settings": {
    "temperature": 0.6,
    "secrets": {},
    "voice": {
      "model": "en_US-hfc_male-medium"
    },
    "model": "medium"
  },

resolved by https://github.com/ai16z/eliza/commit/649946c0e375e89ab64de55e69bb37a224f0fa50


fix rollup tips

fix rollup tips:Treating 'rxjs/add/operator/first' as external dependency
No name was provided for external module 'rxjs/add/operator/first' in options.globals – guessing 'rxjs_add_operator_first'

@mniya Thanks! Could you sign the CLA? LGTM aside from that.

I signed it!

Can you help me closed it?This commit has some problems.I can re pull request.

@mniya your changes are fine, the CLA is just missing

@googlebot  I signed it!


Optionally disable caddy

We're moving wikiapiary back to WMCloud, but this means we'll be sitting behind WMCloud's reverse proxy that provides SSL termination.  As a result, we don't need Caddy and would like to disable it.
For now, I have gotten around this by adding the following to docker-compose.override.yml:
  varnish:
    ports:
      - 80:80

I've looked, but this is not a way to remove ports using the override file, so the startup looks like this:
$ sudo canasta start
2023/05/20 18:31:38 Using /etc/canasta for configuration...
Starting Canasta installation ''...
Creating network "wikiapiary_default" with the default driver
Creating wikiapiary_caddy_1 ...
Creating wikiapiary_caddy_1         ... error
Creating wikiapiary_db_1      ...
Creating wikiapiary_elasticsearch_1 ...
Host is already in use by another container
Creating wikiapiary_varnish_1       ... done
Creating wikiapiary_db_1            ... done
Creating wikiapiary_elasticsearch_1 ... done
Creating wikiapiary_web_1           ... done

ERROR: for caddy  Cannot start service caddy: driver failed programming external connectivity on endpoint wikiapiary_caddy_1 (bc65595f04698b9e4f8c0bb671b9840b1a5dc8eab2de79bf0b8d7d6f62c46190): Bind for <IP_ADDRESS>:80 failed: port is already allocated
Encountered errors while bringing up the project.

This is a good, oft-requested feature. We need to make changes in CanastaWiki/Canasta and CanastaWiki/Canasta-DockerCompose + CanastaWiki/Canasta-Kubernetes.

The right way to do this in Docker Compose is to use profiles. How should this be done in Kubernetes? Would we implement something using Helm? Is there a known best practice or "upstream" approach used in WMF operations?

One 'hack' to disable Caddy would be the following in docker-compose-override.yml (using the -r flag to canasta create):
services:
  caddy:
    image: alpine:latest
    restart: "no"
    entrypoint: ["echo", "Caddy is disabled"]
  varnish:
    ports:
      - 80:80

_ hack provided by @cicalese _

Although a docker-compose-override.yml workaround was implemented and merged https://github.com/CanastaWiki/Canasta-DockerCompose/pull/46 the Canasta CLI still assumes that Caddy is running. The CLI is the recommended way to use Canasta, so that assumption runs deep (meaning the CLI needs to change, and documentation needs to change; along with changes to the Compose repo to implement this issue).
Note: Just a little nuance from the comment above; the implemented workaround in pull 46 still assigns the web ports to Caddy (not varnish), but since it's in an override file, the system administrator can manually disable it without altering the Canasta compose file.
I'm sure there are many use cases where an existing infrastructure will have some other TLS termination. Or, the target host is either air-gapped or some virtual environment without public networking where Caddy fails to do its magic. This means that the Caddy service, although a valuable component of the Canasta Stack, should be optional.
Caddy can be made optional by using the Docker Compose feature called 'profiles', part of the compose file services element, like so:
version: '3.7'
### snip ####
  caddy:
    image: docker.io/library/caddy:2.4.6-alpine
    profiles: ["tls"]
    restart: unless-stopped
    entrypoint: caddy run --config /etc/caddy/Caddyfile --adapter caddyfile
    environment:
      - MW_SITE_FQDN=${MW_SITE_FQDN:-localhost}
    volumes:
      - caddy-data:/data
      - ./config/Caddyfile:/etc/caddy/Caddyfile
### snip ###

Then, either of the following would start the (optional) Caddy service.
docker compose --profile tls up -d
COMPOSE_PROFILES=tls docker compose up -d

Since all services without named profiles get started by default, maybe we could get fancy with a definition like
    profiles: ["${CADDY_PROFILE}"]
and an .env.example with the following
# Uncomment the next line to disable the Caddy application server and TLS endpoint in favor of your own infrastructure
# CADDY_PROFILE=caddy_NOT_enabled

This way, Caddy would be default ON, but easy to disable by uncommenting a line in the .env

It's worth mentioning that Caddy is extremely smart about providing HTTPS even for 'localhost' - by creating a self-signed certificate. So "my system is local" or "air gapped" isn't truly a problem for Caddy. The only true use case for making Caddy optional is that there will be people who already have some Application Distribution Controller (ADC) or Load Balancer product where they manage their TLS endpoint.


ODHack: Analyze user behavior across different lending protocols

"Analyze user behavior across different lending protocols.
Steps:

Load the data on loans for all lending protocols from the Google Storage. For example, https://storage.googleapis.com/derisk-persistent-state/zklend_data/loans.parquet is the file with loans for zkLend. It contains the information about the user, protocol, the user's collateral and debt (tokens and amounts). Write the loading part in a way that the source can be easily changed from the Google Storage to a local database.
Visualize the behavior of a single user across the lending protocols in a Jupyter notebook. Use the following tokens: ""ETH"", ""wBTC"", ""USDC"", ""DAI"", ""USDT"", ""wstETH"", ""LORDS"", ""STRK"", ""UNO"" and ""ZEND"". You should be able to use the visualizations to answer the following questions:

How many users provide liquidity on just 1 protocol? How many users use 2, or more protocols?
How many users borrow on just 1 protocol? How many users use 2, or more protocols?
Created a Venn diagram to visualize the above.
Visualize the above taking into account the staked/borrowed capital. I.e. if a user has e.g. 10k USD (parameter) worth of capital deposited in the pools, how is it distributed across lending protocols?
Visualize the above on a per token basis.
Feel free to come up with your own questions, metrics, hypotheses and visualizations."

Definition of Done
The code functions well and is documented, the analysis provides meaningful outputs and answers the questions from the setup.

Hi, can i jump on this issue

Hi @lukaspetrasek  can I work on this

Hi, can you guys please tell me something about you, what skills/experience do you have and how do you plan to tackle this issue?

Hi, can you guys please tell me something about you, what skills/experience do you have and how do you plan to tackle this issue? This task is not simple, so I have to learn more information before I assign anyone 🙏🏼

I have worked on something similar to this before the difference was the dataset was stored in a csvfile not on a Google storage.
This project basically involves data visualization for informed decision making.
For this project i will be using python.
### Steps to tackle task

Install required libraries like pandas, matplotlib, seaborn etc
Load the data from google storage using the google cloud sdk
Analyze and visualize user behavior

using a jupyter notebook
visualize user behavior across protocols
create the venn diagram
visualize staked capital using the appropriate chart
perform token analysis

Documentation of the codes

Okay, assigning you @NueloSE 👍🏼
@NueloSE Let me know if everything is clear. If you have any questions, please ask here. What is you TG handler please? 🙏🏼
Consider joining our TG group.
See also our contributor guidelines.

Hi @NueloSE , I assume the PR is ready for review, right?

@lukaspetrasek, i have implemented all requested changes. It is ready for review : a676ecc

@NueloSE has started working on this, but the task is still not completely finished.
What's been done: https://github.com/CarmineOptions/derisk-research/pull/107

I am applying to this issue via OnlyDust platform.
My background and how it can be leveraged
I am a python dev. I am a new-comer and I am interested in solving this issue.

I am applying to this issue via OnlyDust platform.
My background and how it can be leveraged
With a background in data analysis using Python, experience with Google Cloud, and proficiency in Jupyter notebooks, I have worked on projects that involve complex data visualization and user behavior analysis. My expertise with tools like Pandas, Matplotlib, and Seaborn allows me to efficiently analyze, manipulate, and visualize large datasets, making me well-suited for this project.
How I plan on tackling this issue
I would start by loading the data from Google Storage, ensuring the code is flexible to switch between cloud and local databases. I’ll perform an initial exploration of the data, using Pandas to handle the loan data and creating visualizations in Jupyter notebooks. For visualizations, I’ll use Venn diagrams to show user engagement across protocols and dive into token-specific behavior. Additional insights like staked/borrowed capital distribution across tokens and protocols will be highlighted, ensuring the analysis is both thorough and meaningful

I am applying to this issue via OnlyDust platform.
My background and how it can be leveraged
I have experience in Python, data analysis, and blockchain protocols. I’ve worked with datasets in Jupyter notebooks, performing behavior analysis and creating visualizations. My background in DeFi and lending platforms makes me well-suited for this task
How I plan on tackling this issue
I would first create a flexible data loader to handle both Google Storage and local databases. Then, I’d analyze user behavior by visualizing data across protocols and answering key questions with Venn diagrams and token-specific graphs. I’d ensure the code is well-documented and capable of answering additional hypotheses.

I am applying to this issue via OnlyDust platform.
My background and how it can be leveraged
HI , i am a blockchain developer with experience in cario, javascript, typescript, solidity, css, html etc. i am an active contributor here on onlydust . this is my first time contributing to this repo. please assign me ,i am ready to work
How I plan on tackling this issue
i intend to approach the issue by carrying out the following :
1Load Data: I will write a function to load loan data from Google Storage or a local database.
2. Visualize Behavior: Show  the how users interact with 1 or more lending protocols and tokens.
3. Venn Diagram: Create a Venn diagram to display users’ protocol participation.
4. Capital Distribution: Visualize capital distribution across protocols and tokens.
5. Document: I will ensure the code is clear, functional, and well-documented.

I am applying to this issue via OnlyDust platform.
My background and how it can be leveraged
Background and Leverage: I have experience in building modular and scalable systems that handle data efficiently. I have worked extensively with APIs, databases, and data visualization libraries, allowing me to approach this problem with a solid foundation in both back-end development and data analysis. My background in both front-end and back-end development will enable me to handle the data-loading part flexibly and create meaningful visualizations to answer key questions.
How I plan on tackling this issue

Loading Data from Google Storage or a Local Database
I will design the data loading functionality in a way that it can be easily switched between loading data from Google Cloud Storage and a local database. This can be done using a modular function that abstracts the data source.

Implementation Plan:
Use Pandas to load the data from Google Storage or the local database (e.g., PostgreSQL).
Create a function to switch between the data source dynamically (Google Storage or local DB).
Use parquet for loading files from Google Cloud Storage (as provided in the example).import pandas as pd
from sqlalchemy import create_engine
def load_data(source="google", protocol="zklend"):
if source == "google":
url = f"https://storage.googleapis.com/derisk-persistent-state/{protocol}_data/loans.parquet"
return pd.read_parquet(url)
elif source == "local_db":
engine = create_engine('postgresql://username:password@localhost:5432/mydatabase')
query = f"SELECT * FROM {protocol}_loans"
return pd.read_sql(query, engine)
Load zkLend data
loans_data = load_data(source="google", protocol="zklend")
This structure allows me to switch between loading from Google Storage and a local database with minimal code changes.
Data Aggregation for Users Across Lending Protocols
Once data is loaded, the next step involves:
Aggregating the data based on users, protocols, and their collateral and debt.
Ensuring that the token types (ETH, wBTC, USDC, etc.) are properly parsed and aggregated.
Implementation:# Aggregate loan data by user and protocol
def aggregate_user_data(data):
return data.groupby(["user", "protocol"]).agg({
"collateral_amount": "sum",
"debt_amount": "sum"
}).reset_index()
Example: Aggregate zkLend data
aggregated_data = aggregate_user_data(loans_data)
3. Visualize the Behavior of Users Across Lending Protocols
A. Number of Protocols Used by Users
To visualize the number of users who use 1 protocol, 2 protocols, or more:
Use the aggregated data to group users by the number of protocols they interact with.
This can be visualized with a Venn diagram or bar plot.
Implementation:
import matplotlib.pyplot as plt
from matplotlib_venn import venn2, venn3
Count users by number of protocols
user_protocol_count = aggregated_data.groupby('user').protocol.nunique()
Visualize the number of protocols used by users
protocol_count_distribution = user_protocol_count.value_counts()
protocol_count_distribution.plot(kind="bar", title="Number of Protocols Used by Users")
plt.show()
B. Venn Diagram for Users Borrowing/Providing Across Protocols
To create a Venn diagram:
Identify users who interact with different protocols (e.g., zkLend, another protocol).
Use the matplotlib_venn package to visualize overlaps.
Implementation:
For simplicity, assume we have user sets for zkLend and another protocol
users_zklend = set(aggregated_data[aggregated_data['protocol'] == 'zklend'].user)
users_other_protocol = set(aggregated_data[aggregated_data['protocol'] == 'other'].user)
Create a Venn diagram
venn2([users_zklend, users_other_protocol], set_labels=("zkLend", "Other Protocol"))
plt.title("Users Borrowing/Providing Across Protocols")
plt.show()
4. Capital Distribution Across Protocols
This analysis involves looking at the total amount of capital (collateral and debt) distributed across the protocols for each user.
You can visualize the distribution of capital across lending protocols in a bar plot or pie chart, adjusted for capital threshold.
Implementation:
Filter users with at least $10k USD worth of capital (collateral + debt)
high_capital_users = aggregated_data[aggregated_data['collateral_amount'] + aggregated_data['debt_amount'] >= 10000]
Visualize capital distribution
high_capital_users.groupby('protocol').agg({
'collateral_amount': 'sum',
'debt_amount': 'sum'
}).plot(kind='bar', stacked=True, title="Capital Distribution Across Protocols")
plt.show()
5. Token-Specific Analysis
To break down the data on a per token basis (e.g., ETH, wBTC, USDC):
Group data by both token and protocol.
Visualize how the capital is distributed for each token across protocols.
Implementation:
Group by token and protocol
token_data = aggregated_data.groupby(['token', 'protocol']).agg({
'collateral_amount': 'sum',
'debt_amount': 'sum'
}).reset_index()
Visualize capital distribution per token across protocols
token_data.pivot(index='token', columns='protocol', values='collateral_amount').plot(kind='bar', stacked=True, title="Capital by Token Across Protocols")
plt.show()

I am applying to this issue via OnlyDust platform.
My background and how it can be leveraged
I am a python dev, i am also working on many blockchain projects,in general i am looking to diversify my portfolio.
How I plan on tackling this issue
Data Loading: Load the Parquet file into a Jupyter notebook using Pandas, ensuring flexibility for local or cloud data sources.
Data Preprocessing: Clean and filter key columns like user ID, protocol, collateral, debt, and tokens.
User Behavior Visualization: Calculate how many users interact with one or multiple protocols. Use bar charts and Venn diagrams to visualize liquidity and borrowing behavior.
Advanced Analysis: Analyze staked/borrowed capital distribution across protocols and visualize it by token type.
Additional Insights: Explore additional metrics like protocol popularity and document findings.

I am a Python developer with experience working on blockchain projects, aiming to broaden my portfolio.
Approach to the Issue
Data Loading: Use Pandas to load the Parquet file into Jupyter for local or cloud analysis.
Data Preprocessing: Clean and filter key fields like user ID, protocol, collateral, and tokens.
Visualization: Analyze user interaction with protocols using bar charts and Venn diagrams for liquidity and borrowing behavior.
Advanced Insights: Examine capital distribution across protocols and visualize token types.
This version keeps your plan intact while being more concise. Would you like to refine any part of it further?

this looks awesome tbvh

I am applying to this issue via OnlyDust platform.
My background and how it can be leveraged
Hi, I am backend developer and i'd like to take this task

I am applying to this issue via OnlyDust platform.
My background and how it can be leveraged
Hi, I'm developer with experience in Starknet, I was working closely with blockchain and web3 technologies


Fixed English in places, added a try:except to prevent any errors.

@routsiddharth  contribute here https://github.com/Ishaan28malik/Get-Dev-Resources


added bundle that supports all active languages

Added bundle that supports all active languages

His can be handy if  site uses js compressor and one js file change only on deploy.
This mean that  all js langs files should be available any time.

Added js var language with project lang.
Added the ability to have all languages in js languageItems var.
Added bundle that contains all active langs can be used for prod js compression.

Thanks!


Algorithms string: "redblueredblue"

Great guide!
I think I might have found an error there: string.md
E.g. "abba" and "redblueredblue" should return true
It should either be: "return false" or "redbluebluered" according to the given pattern.

Closed by #20


pull request for e2e test at 01/13/2017 03:26:09

:white_check_mark: Validation status: passed
For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Upgrade to JHipster v8.7.1

closes #2075

@pascalgrimaud,  bounty claimed at https://opencollective.com/generator-jhipster/expenses/221266

@vishal423 : approved


Release 1.3.0 prep: upgraded helm charts, library versions

Issue #, if available:
Description of changes:
Release 1.3.0 prep: upgraded helm charts, library versions
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

/do-e2e-tests


changing percentage style at variable coverage table

Following #250 issue, toPercentage() is used for variable coverage table. But one question remains that the function, toPercentage, is actually returned either > 99 or < 1 (see screenshot that was tested at scatterplot viz), not decimal points like > 99.99 or < 0.01. If we need to support more precise decimal points like Bob mentioned in the issue, then we can probably make a function that is similar to toPercentage(). Just let me know @bobular :)

@bobular After testing some cases, I think that >99% and <1% seems to be quite reasonable values we may use in general situations: two decimal points are too small to satisfy. For example, the exact Data percentage of above screenshot (scatter plot one I have uploaded) is 99.969 and 99.978. If we use two decimal points like 99.99 in this case, which would have a criterion of larger than 99.994, then it would be shown as 100%.
Alternatively, I think that we may use Math.floor, which would prevent the issue of showing 100% with very small number of 'No Data'?

sorry mistakenly pressed Close with comment :(

Sorry DK - I mistakenly remembered the function returning decimal places (e.g. 99.99%).  You are right that the current behaviour should suit us just fine.


Relative function paths aren't resolved in schedule clear commands

As the title says, the schedule clear command doesn't have its relative functions resolved.
There's schedule clear which for whatever reason Mojang decided should use the brigadier:string parser and also be greedy. I suspect this is the reason for this particular subcommand.
I did a brief scan and couldn't figure out why this is happening for the schedule function subcommand. It uses the minecraft:function parser just like the function command does, and the latter works just fine. Could it have something to do with schedule function taking additional trailing arguments?
Update: schedule function works fine and I must have confused something with schedule clear in my testing.

Relative resource locations are resolved during parsing by the resource location parser so it looks like brigadier:string was indeed the issue. This is fixed in v0.34.1 thanks to a new system that allows mecha to load patches for the command tree.


Qingwei/fix set data

OK to merge, published

Coverage increased (+0.07%) to 41.053% when pulling 41c823a01182553b04ee336b5cba9ff67803a2dd on qingweibinary:qingwei/fix_setData into cc4fb4b30159f9b6fcc8c59c3381fcad0bd2180c on binary-com:master.


Try s390x build with Ubuntu's etcd

etcd upstream doesn't build/provide s390x builds.
I've modified the part, to download/unpack/use Ubuntu's ectd to create s390x snap of microk8s. It built, but I don't know if it works at all. See the snap at https://code.launchpad.net/~xnox/+snap/xnox-microk8s-test/+build/1142929
Maybe we can cross-build exact same etcd release as a part on Ubuntu? Or is slightly different etcd ok for microk8s?

Hi @xnox, thank you for this PR.
I would much prefer to have a part similar to [1] as the etcd snap is maintained by our team or use the etcd snap as a stage snap [2]. We would also need to find a s390x machine to test this before merging it.
[1] https://github.com/juju-solutions/etcd-snaps/blob/v3.4/snap/snapcraft.yaml
[2] https://forum.snapcraft.io/t/stage-snaps/11001

Hi @xnox, thank you for this PR.
I would much prefer to have a part similar to [1] as the etcd snap is maintained by our team or use the etcd snap as a stage snap [2]. We would also need to find a s390x machine to test this before merging it.
[1] https://github.com/juju-solutions/etcd-snaps/blob/v3.4/snap/snapcraft.yaml
[2] https://forum.snapcraft.io/t/stage-snaps/11001

I like stage snap. Would you want that for all arches? or just s390x (and the rest continue to reuse upstream builds from github)?

s390x machine access is easy for me, i just don't know what to test.

I like stage snap. Would you want that for all arches? or just s390x

Lets take one step at a time and use the stage-snap only for s390x.

s390x machine access is easy for me, i just don't know what to test.

As soon as you build the snap you should be able to snap install ./yournap.snap --classic --dangerous and you should be able to call microk8s.kubectl get all -A. There you should see the calico CNI crashing because the calico docker image does not exist for s390x. This is the next step!

@xnox - I am working in support for armhf so my work at #719 might help - there I am building etcd on not supported platforms so it matches the exact version used by microk8s.

s390x is available in travis too, if you have that connected for CI here (at least on s390x).

@xnox we merged a PR to build etcd from source for architecture where prebuild binaries do not exist. Building from source has the benefit of not pining us to a specific version. Does building from source work for the s390x case?

@xnox we merged a PR to build etcd from source for architecture where prebuild binaries do not exist. Building from source has the benefit of not pining us to a specific version. Does building from source work for the s390x case?

YES!

YES!

Great, I am closing this PR then.


scGPT installation problem

Hello, I encountered an error while executing pip install scgpt. The error message says "No module named 'torch'", but I have already installed "torch". I'm not sure what could be causing this issue.

Hi, it looks like an installation issue with flash-attn. I noticed there has been various issues reported about new versions of flash-attn. I recommend using CUDA 11.7 and flash-attn<1.0.5 for now.
Please see the new notice I put in the note here in readme. https://github.com/bowang-lab/scGPT#installation

Thank you for your reply, I would like to ask if scGPT can be used when the computer or server does not have a GPU？

Hi, it looks like an installation issue with flash-attn. I noticed there has been various issues reported about new versions of flash-attn. I recommend using CUDA 11.7 and flash-attn<1.0.5 for now.
Please see the new notice I put in the note here in readme. https://github.com/bowang-lab/scGPT#installation

Thank you for your reply, I would like to ask if scGPT can be installed and used when the computer or server does not have a GPU？

Hi, technically, it should be able to run on CPU. But currently, due to some legacy choice, you'll need the flash-attn to load pretrained models, and flash-attn only works with GPU. I am considering adding

a pip install option for CPU only version, such as pip install scgpt-cpu
Relax the requirements on flash-attn, and support the loading of pretrained model in a native pytorch implementation on cpu

Hi, technically, it should be able to run on CPU. But currently, due to some legacy choice, you'll need the flash-attn to load pretrained models, and flash-attn only works with GPU. I am considering adding

a pip install option for CPU only version, such as pip install scgpt-cpu
Relax the requirements on flash-attn, and support the loading of pretrained model in a native pytorch implementation on cpu

Thank you very much for your reply, looking forward to your follow-up updates

Hi,
Congrats and thanks for the great tool. Continuing the discussion, I tried several ways of getting the installation running with flash-attn being a problem (torch not found or some other errors). The flash-attn repo has the same issues and is not always resolved : https://github.com/HazyResearch/flash-attention/issues/246 . I would be really grateful if you could provide us a docker/singularity container which can be used to run the program.

Thank you for the nice suggestion. I will try to set it up next week. In the meantime, are you using flash-attn<1.0.5? If not, I would suggest having a try

Hi,  the main problem I have with the installation is that my nvidia cuda drivers are 12.1.  So if I use a docker container with pytorch for 12.1 and I build flash-attn from source, when I pip install scGPT, it proceeds to downgrade my torch and cuda drivers to 11 and rebuild flash-attn for cuda11.  So of course, it won't run with the mismatched drivers.  Can the requirements for torch be set to >= instead of == ? Or is there some other workaround?  thanks.

seems to come from the torchdata package.. it downgrades to torch2.0.1 and then cuda11..
root@d6088c2b9744:/workspace# pip show torch
Name: torch
Version: 2.1.0a0+fe05266
...
root@d6088c2b9744:/workspace# pip3 install torchdata
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting torchdata
Downloading torchdata-0.6.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.6 MB)
|████████████████████████████████| 4.6 MB 3.4 MB/s
Requirement already satisfied: requests in /usr/local/lib/python3.8/dist-packages (from torchdata) (2.28.2)
Requirement already satisfied: urllib3>=1.25 in /usr/local/lib/python3.8/dist-packages (from torchdata) (1.26.15)
Collecting torch==2.0.1
Downloading torch-2.0.1-cp38-cp38-manylinux1_x86_64.whl (619.9 MB)
|████████████████████████████████| 619.9 MB 17.2 MB/s
Collecting nvidia-nccl-cu11==2.14.3
Downloading nvidia_nccl_cu11-2.14.3-py3-none-manylinux1_x86_64.whl (177.1 MB)
|██████████▎                     | 56.6 MB 40.0 MB/s eta 0:00:04^C

is it possible to swap out for torchdatasets
https://github.com/szymonmaszke/torchdatasets

something else also wants torch besides torchdata. So, upgrading it is unlikely to fix it..
#31 17.71 Requirement already satisfied: torchdata==0.6.1 in /usr/local/lib/python3.8/dist-packages (from torchtext>=0.14.0->scgpt==0.1.2.post1) (0.6.1)
#31 17.94 Collecting torch>=1.8.0
#31 18.00   Downloading torch-2.0.1-cp38-cp38-manylinux1_x86_64.whl (619.9 MB)
#31 44.07 Collecting nvidia-cusparse-cu11==<IP_ADDRESS>

Thank you for the nice suggestion. I will try to set it up next week. In the meantime, are you using flash-attn<1.0.5? If not, I would suggest having a try

I did flash-attn 1.0.4 ... just running into more problems.

pip install flash-attn==1.0.6 --no-build-isolation
This solved my problems. flash-attn 1.0.6 will not require re-installation of pytorch.

uninstall all the relative drivers for nvidia GPU ,reinstall them through local run file, make sure the output of nvcc -V matches your cuda version.

@shenyeyouyi Thank you. I agree that nvcc -V should tell the current visible cuda version, especially when you have multiple cuda versions installed.

In a conda environment I followed the following steps and solved my problems:
mamba install python=3.10.11 cudatoolkit=11.7 cudatoolkit-dev 'gxx>=6.0.0,<12.0' cudnn r-base r-devtools
pip install packaging
pip install flash-attn==1.0.6 --no-build-isolation
pip install scgpt

I hope this helps.

Hi, @scarpio02. Thanks, but I think you may be omitting details:
pip install flash-attn==1.0.6 --no-build-isolation
results in:

Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting flash-attn==1.0.6
(...)
Preparing metadata (pyproject.toml) ... error
error: subprocess-exited-with-error
× Preparing metadata (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [13 lines of output]
Traceback (most recent call last):
(...)
File "", line 13, in
ModuleNotFoundError: No module named 'torch'

Would you mind sharing on what type of instance or container you ran this? If you used an Nvidia PyTorch container, what version did you use? If not, how did you get the drivers and other packages/apps installed, what's the path to nvcc (next error after I install Pytorch), etc.? I can share those details, but that would probably not be useful.

It seems that you didn't install Pytorch? Maybe installing Pytorch-gpu version can solve the problem?

Hi, @bzip2 , you don't necessarily need the Nvidia PyTorch container. You do need pytroch, cuda, and a compatible GPU before installing flash-attn. So can you please share those details?

after installing drivers on the PC, the above comment worked for me. even with less steps:
pip install packaging torch torchvision torchaudio && pip install "flash-attn<1.0.5" --no-build-isolation && pip install ipykernel pandas scanpy scvi-tools numba --upgrade "numpy<1.24" torchtext scib datasets==2.14.5 transformers==4.33.2 wandb cell-gears && pip install --no-deps scgpt

the guide on the readme page should be updated with the suggestion here. I was able to install scGPT with everyone's input here!


Secure SSH between mysql master-slave

All mysql masters and slaves start off with the same public/private ssh keypair. As such, someone could obtain the key by using the same container and retrieving the key from there.
A possible way to secure this is to pass in the public/private keypair through environment variables.

Migrated to Trello.
https://trello.com/c/sUXvQC2f


Running on aarch system

I would like to run this node on an aarch system, is this possible?

I was able to determine there is no docker image for aarch by looking here: https://hub.docker.com/search?q=mantlenetworkio%2Fl2geth
Can you explain how to compile l2geth myself?
Is this the right repo to be looking through: https://github.com/mantlenetworkio/mantle-v2


Splunk Observability Scaler - Initial PR

Provide a description of what has been changed
Checklist

[ ] When introducing a new scaler, I agree with the scaling governance policy
[ ] I have verified that my change is according to the deprecations & breaking changes policy
[ ] Tests have been added
[ ] Changelog has been updated and is aligned with our changelog requirements
[ ] A PR is opened to update our Helm chart (repo) (if applicable, ie. when deployment manifests are modified)
[ ] A PR is opened to update the documentation on (repo) (if applicable)
[ ] Commits are signed with Developer Certificate of Origin (DCO - learn more)

Fixes #

Relates to #

Hi @JorTurFer,
I will clarify this and get back to you.

Is this still active?

I hope so :) Sebastian was off for a while as far as I understand.

There is other PR merged supporting Splunk -> https://github.com/kedacore/keda/pull/5905
Is this a different feature or so?

Hi @JorTurFer, this seems to be independent of our work on a Scaler for Splunk Observability.

Could we extend the current Splunk scaler instead of creating a totally new one? (IDK if it's possible or not tbh)

Yes, I'd even think its for the better.

Yes, I'd even think its for the better.

Thanks ❤  by chance, 2 different contributions related with spluk have been done at the same time (this and the other already merged) xD.
We want to cut a release during the next week, if the PR is merged before Thursday, it'll be released next week (no rush at all, if it's not during this release, it'll be in the next one)

Hi @zroubalik,
the work on a Splunk Keda scaler on the mentioned PR was regarding our Splunk Enterprise/Cloud solutions. I would like to work towards a Keda scaler for Splunk Observability Cloud.
If that is alright with you, I'd like to submit another PR in a "proper fashion", and therefore we can delete this PR.
Thank you, and apologies for all the confusion.


Very high cpu usage when typing anything

I do really enjoy using volar, it's incredible tool for vue3 and typescript.
But I've noticed that when typing anything volar consumes big amount of cpu, even when I type comment.
after disabling volar highest process using at most 2% cpu
Here's video https://www.youtube.com/watch?v=4kastswNIUs
Is it normal? IMO It shouldn't use that much of resources
I'm using
Macbook M1
Latest VSCode insiders
Latest Volar

Can you record again after disable volar.autoCompleteRefs?

changing volar.autoCompleteRefs didn't change anything
Can I do profiling with firefox? I don't want to install anything from google

I disabled every option in volar settings, still same usage

Profiled record
CPU-20210717T012645.cpuprofile.zip

Can I do profiling with firefox?

Sorry I don't know, maybe you can use Edge but I'm not sure.

I disabled every option in volar settings, still same usage

Thanks for the profiling record, but this is HTML server profiling, we need API server and Document server profiling.

I checked on windows pc, there were no problem like that

It may also be just a resource allocation problem for M1. Can you compare the CPU usage of typing in *.ts and typing in *.vue?

It may also be just a resource allocation problem for M1. Can you compare the CPU usage of typing in *.ts and typing in *.vue?

It's same usage, also I can't be 100% accurate if it's not existing on windows as I could just not notice on I9 cpu

Thanks for the profiling record, but this is HTML server profiling, we need API server and Document server profiling.

My bad, here's all of them
profiles.zip

Profiling record shows that everything is works good.
Since you mentioned the same problem with *.ts typing, this is more likely a vscode / macbook M1 problem, because *.ts is not handled by volar, but by the built-in TS extension of vscode. To confirm this, please try to disable volar, then typing in *.ts again and check the cpu usage.
In addition, please also try the non-insiders version of VSCode.

Since you mentioned the same problem with *.ts typing, this is more likely a vscode / macbook M1 problem, because *.ts is not handled by volar, but by the built-in TS extension of vscode. To confirm this, please try to disable volar, then typing in *.ts again and check the cpu usage.

But the volar process gets to 200-300% cpu usage typing even on ts files. As I said , disabled volar and highest cpu usage were round 2-3% process.
I tried normal vscode, same thing.
Here's another screen record with vue and ts files - see that @volar are still using cpu even with ts file https://www.youtube.com/watch?v=oZ1ABtgyaOY
And here's with volar disabled, usage are pretty fine then
https://www.youtube.com/watch?v=Tujra4gM0AM

Thanks for your feedback, I will test this issue on volar-starter + macbook m1.
How to open the cpu usage panel in your video?

You need to have homebrew, here's instructions-https://brew.sh/
Then you do brew install htop and sudo htop (Its recommended to use sudo) and click on cpu tab to sort it by usage.

Thanks for the information!
Please try to setup "editor.semanticHighlighting.enabled": false and check cpu usage again.

Thanks for the information!
Please try to setup "editor.semanticHighlighting.enabled": false and check cpu usage again.

I changed it to false and reloaded vscode, still same thing. I also tried removing my settings.json but it also didn't do anything.

Can you provide Document server profiling record with "editor.semanticHighlighting.enabled": false?

Sure - here profiles1.zip
I'm starting thinking if it's not an normal behviour, I'll test how it looks on my older windows laptop.
Can you tell me your cpu usage of app while typing anything in vscode with volar on?

Don't know why but setup "editor.semanticHighlighting.enabled": false seem no effect for you, semantic tokens is still collect. Please try remove this line https://github.com/johnsoncodehk/volar/blob/master/packages/vscode-client/src/extension.ts#L47. And run debug mode to check cpu usage and profiling again.
In the expected situation, the document server keeps running when typing, because the diagnosis of the document server is very time-consuming, the diagnosis speed does not catch up with the typing speed during continuous typing, and the server continues to abort the old diagnosis and start new ones. Diagnose until you stop typing and wait for the final diagnosis to complete. I can increase the diagnostic delay to alleviate this problem, but I need to strike a balance between performance and UX. On the other hand, I can see if reduce the work of the document server can alleviate the problem, which is why I asked you to turn off editor.semanticHighlighting.enabled.
We can't control progress cpu usage. Regarding whether a single process full loading will cause overheating or not, I think it base on how vscode/cpu/macbook handle it. Macbook has Tubro Boost feature to increase power consumption to speed up program execution when progress high loading, but this conflicts with our expectations. We hope use a process to keep it full loading to get the best UX. (btw, software like Turbo Boost Switcher can turn off the Tubro Boost feature.)
Without requiring users to install additional software, I need to consider how to reduce document server loading.

I removed this line, cleared cache ran debug and still same thing happens with cpu.

We can't control progress cpu usage. Regarding whether a single process full loading will cause overheating or not, I think it base on how vscode/cpu/macbook handle it. Macbook has Tubro Boost feature to increase power consumption to speed up program execution when progress high loading, but this conflicts with our expectations. We hope use a process to keep it full loading to get the best UX. (btw, software like Turbo Boost Switcher can turn off the Tubro Boost feature.)
I'm not sure if M1 one has this function, they already are very powerfull and at most it throttles a bit when it gets hot.

I found about M1

The M1 is a little different: Apple says it doesn't have turbo boost. It runs at its top clock speed most of the time

And I can agree with it, M1 is blazing fast and even without any fan it most of time stays cold.
I just checked thermals.
While having couple things running in background + twitch stream etc and having connected 3440x1440@144hz monitor it has round 55-60 degrees. But when I start typing anything in vscode it  jumps to 85 degrees in couple seconds. I did test vetur in same way,  it also affects cpu usage but not that much.
Anyway I'd be really happy if somehow it be decreased, because when I work with nodejs+ts+plugins or ruby on rails there are no things like that, if I could help with debugging it dont hestitate to ask!

I removed this line, cleared cache ran debug and still same thing happens with cpu.

Can you provide profiling record?

Hello, I also have this problem. When MacBook opens this plug-in, the CPU usage is soaring, and the cooling fan is running all the time. I have tried these methods. Is there a better solution at present

@dongshihao666 I'm still looking for a way in volar. Have you try Turbo Boost Switcher?

I'm using
MacBook Pro (13-inch, 2020, Four Thunderbolt 3 ports)
2 GHz  Four core Intel Core i5
6 GB 3733 MHz LPDDR4X
Latest VSCode insiders
Latest Volar

I have the same problem
when i use volar cup goes very high

I removed this line, cleared cache ran debug and still same thing happens with cpu.

Can you provide profiling record (only document server)?

Sure, here
CPU-20210722T175848.cpuprofile.zip

Sure, here
CPU-20210722T175848.cpuprofile.zip

Thanks! It is clearer.
I made performance optimization in 0.26.7 based on your profiling, but I am not sure is it ease cpu usage. Please let me know the result if you try it.

When I update to 0.26.9, it still takes a lot of time to update the file name

When I update to 0.26.9, it still takes a lot of time to update the file name

This is a different problem, has not optimized this yet, please open a new issue to track.

I can confirm there is quite a bit of performance lost when using Volar, even when just editing .ts files. To reproduce this, edit a template in a .vue file and then edit a .ts file anywhere else in the project and you can see how it prompts extra processes to fire. I'm not using a Macbook or laptop; I'm on a desktop computer with an Intel quad core.
Without Volar editing a .ts file.

With Volar after editing a .vue file and then immediately editing a .ts file.

It appears as though volar is running redundant processes unnecessarily, but that's a very ignorant assumption considering I don't know how the internals work.

@Jaeiya When you editing *.ts, volar need to update your opened vue document diagnostics because because there may have references.
Simply look at yours capture, when you editing ts script, TS server using 15% cpu and 401MB memory, volar using 24% cpu and 479MB memory for two TS language service (script and template), this is expected or even ideal.
If you close other vue document when you editing ts script, volar should be stop using cpu because no vue diagnostics need to update.
btw close this issue because already resolved the original performance profiling issue and get some users confirm in Discord, please open a new issue for other performance issues.

After some time of testing I can confirm it's better. Thanks


Auto-deployment to PaaS?

The GDS Way auto-deploys (see: https://github.com/alphagov/gds-way/blob/master/.travis.yml ). We could easily add example config to do that to the .travis.yml in tech-docs-template, commented out with instructions to enable it in the README?

Sounds like a sensible solution to me. I'm happy to help documenting that when it's in a place to do so.

Since the docs have docs now, this could be added to https://github.com/alphagov/tech-docs-manual.

Note that Travis' CloudFoundry provider does not provide zero downtime deploys – deploying the site will result in your documentation site disappearing (returning a json 404) whilst the old container is destroyed.
This might be fine, but if the docs are public facing you might need to do something more involved. For the Design System we use autopilot but it's rather more involved:

https://github.com/alphagov/govuk-design-system/blob/master/.travis.yml#L15-L19
https://github.com/alphagov/govuk-design-system/blob/master/.travis.yml#L39-L67
https://github.com/alphagov/govuk-design-system/blob/master/bin/deploy-travis

Been attempting to deploy a tech docs site to PaaS, and run into a few issues which may have been avoided had additional documentation and/or an example config file been provided.
We’re also using Travis, and found that we needed to add the following values to .travis.yml:
before_install:
  - gem install bundler
script:
  - bundle exec middleman build --verbose

This explicitly installs Bundler prior to building the site (not sure why, but Travis was complaining about not being able to find Bundler), and overrides the default build script to build the site using Middleman rather than execute rake.