Quantization, generation quality and memory usage

System Info
The full command line used that causes issues: docker run --gpus all --shm-size 1g -p 8080:80 -v $volume:/data ghcr.io/huggingface/text-generation-inference:1.0.2 --model-id WizardLM/WizardCoder-15B-V1.0 --quantize bitsandbytes
OS: Ubuntu 20.04.6 LTS
Rust version: cargo 1.71.1 (7f1d04c00 2023-07-29)
Model being used: WizardLM/WizardCoder-15B-V1.0
Hardware used: 3090TI 24GB
The current version being used: 1.0.2
Information

[X] Docker
[ ] The CLI directly

Tasks

[X] An officially supported command
[ ] My own modifications

Reproduction

You can load the model to see the difference in memoty usage between usual loading and TGI
Usual:
BASE_MODEL_ID = 'WizardLM/WizardCoder-15B-V1.0'

tokenizer = AutoTokenizer.from_pretrained(BASE_MODEL_ID)
model = AutoModelForCausalLM.from_pretrained(BASE_MODEL_ID,
  device_map="auto",
  trust_remote_code=True,
  return_dict=True,
  load_in_8bit=True)

TGI:
docker run --gpus all --shm-size 1g -p 8080:80 -v $volume:/data ghcr.io/huggingface/text-generation-inference:1.0.2 --model-id WizardLM/WizardCoder-15B-V1.0 --quantize bitsandbytes

With AutoModelForCausalLM.from_pretrained 8-bit version of model takes about 17GB VRAM, but with TGI it takes about
21GB VRAM
Also there is something strange when I use --quantize bitsandbytes-nf4 or --quantize bitsandbytes-fp4 because it takes more VRAM (22454MiB to be exact compared to 21350MiB using --quantize bitsandbytes)

There is a problem with generation quaity. Sometimes artifacts appear in the form of code repetitions, strange characters and
looping (for example, it reaches some port and writes <IP_ADDRESS>.<IP_ADDRESS> until it reaches the maximum number of tokens). This is
especially evident if I send several requests for processing at the same time. I tested with 10 requests at the same time.
The repetition penalty doesn't help much and for my purposes it often makes things worse
Exmple of body which I send to generate endpoint:
 {
    "inputs":"Below is an instruction that describes a task. Write a response that appropriately completes the request\n\n### Instruction: create Java classes according to this PlantUML diagram:\n\n@startuml\n\nentity Book {\nid: long\nname: string\nlanguage: string\nyearOfPublishing: int\n}\n\nentity Author {\nid: long\nfirstName: string\nlastName: string\nnationality: string\n}\n\nenum Genre {\nSCIENCE_FICTION\nFANTASY\nHORROR\nTECHNICAL_WRITING\nEROTIC_FICTION\nWESTERN\nOTHER\n}\n\nBook \"1..N\" -o \"1\" Author: books\nBook \"1\" o- \"1..N\" Genre: genres\nAuthor \"1\" o- \"1..N\" Genre: genres\nBook \"1..N\" o- \"1\" Author: author\n\n@enduml\n\n### Response:",
    "parameters":{
        "max_new_tokens":600,
        "temperature": 0.1,
        "top_k": 1,
        "top_p": 0.1,
        "repetition_penalty": 1.0
    }
}

Expected behavior
I want to load model in 8 bit
First of all, I expect better generation quality. When I used the model with AutoModelForCausalLM.from_pretrained and did the inference with a batch of 10 prompts, I got responses without such artifacts
I also expect to use less VRAM because the model used to take up 4GB less memory (if possible)

Ok, I just tried.
Output is indeed very bad for --quantize bitsandbytes but seems ok with --quantize bitsandbytes-nf4.
Everything seems OK on meta-llama/Llama-2-7b-hf.
This leads me to believe that there's just a mismatch between the model and BNB-8bit somewhere.
The error could be here, but since it works without quantization and in 4bit I'm inclined to think that it's more that somehow the 8bits quantization screws things for this particular model.
If that's true that would be extremely interesting to understand deeply (since understanding how quantization fails could lead to betterquantization schemes).

i also tried meta-llama/Llama-2-7b-hf with bitsandbytes and bitsandbytes-nf4.  memory consumption is the same. it's around 22GB.

And this is very surprising. I can understand the increase in memory if some additional things are loaded into memory. But there must be difference between the 15B and 7B models. And between quantized versions too

Ok, now it's clear to me. Thank you!
I have one more question. The documentation says that the Starcoder architecture is supported. Maybe I'm wrong and I'm talking nonsense but as I understand it, WizardCoder is based on Starcoder or they just have the same architecture. In this case, will WizardCoder be loaded differently from Starcoder? If so, could you please tell me in which files are these models loading? More llikely WizardCoder are loading with server/text_generation_server/models/causal_lm.py, but I can`t see file for starcoder

Ok, now it's clear to me. Thank you!
I have one more question. The documentation says that the Starcoder architecture is supported. Maybe I'm wrong and I'm talking nonsense but as I understand it, WizardCoder is based on Starcoder or they just have the same architecture. In this case, will WizardCoder be loaded differently from Starcoder? If so, could you please tell me in which files are these models loading (if you know)? More llikely WizardCoder are loading with server/text_generation_server/models/causal_lm.py, but I can`t see file for starcoder

https://github.com/huggingface/text-generation-inference/blob/main/server/text_generation_server/models/__init__.py#L124

Closing this issue since it seems resolved.

Seems in my case I try to load  meta-llama/Llama-2-13b-chat-hf in bitsandbytes or bitsandbytes-nf4  but still use more VRAM than the default model? Any ideas?

TGI uses all VRAM available for batching and improving throughput. You can limit the amount of VRAM used by TGI with the --cuda-memory-fraction arg.
In this case, the % of VRAM used by the model decreases when using quantization and you have more VRAM for batching.

I see, but I have another question, is the memory only (vram) that matters or the GPU compute capability will have better results too
Assume I ran A100 40GB vs T4 64GB


Modify schema to work with the database beta

@dpetrick is this a temporary or long term limitation?

This should be undone as soon as Graphcool supports this again.


GitHub: migrate draft releases too

close https://codeberg.org/Codeberg/Community/issues/447
to reproduce:

create draft release
try to migrate with releases

Codecov Report

Merging #15884 (3f8dd9f) into main (b6b8b19) will increase coverage by 0.02%.
The diff coverage is 53.05%.

@@            Coverage Diff             @@
##             main   #15884      +/-   ##
==========================================
+ Coverage   44.00%   44.03%   +0.02%
==========================================
  Files         681      681
  Lines       82270    82318      +48
==========================================
+ Hits        36205    36248      +43
- Misses      40158    40165       +7
+ Partials     5907     5905       -2

Impacted Files
Coverage Δ

cmd/web.go
0.00% <0.00%> (ø)

modules/indexer/code/indexer.go
31.86% <0.00%> (-0.72%)
:arrow_down:

modules/migrations/gitea_uploader.go
7.44% <0.00%> (-0.03%)
:arrow_down:

modules/queue/bytefifo.go
0.00% <0.00%> (ø)

modules/queue/queue_redis.go
4.76% <0.00%> (+0.21%)
:arrow_up:

modules/queue/queue_wrapped.go
5.26% <0.00%> (+0.06%)
:arrow_up:

modules/queue/unique_queue_redis.go
4.25% <0.00%> (+0.08%)
:arrow_up:

routers/routes/base.go
23.93% <0.00%> (-1.53%)
:arrow_down:

modules/graceful/manager.go
27.43% <24.59%> (-1.60%)
:arrow_down:

modules/queue/unique_queue_channel.go
54.11% <27.02%> (-10.40%)
:arrow_down:

... and 37 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 17c5c65...3f8dd9f. Read the comment docs.

-> #15888


Fix syntax error in openapi-generator command

Previously running yarn genapi was failing with the following error:
/bin/sh: 1: Syntax error: "(" unexpected

I believe this is because yarn is trying to run the command with sh instead of bash or another shell where the <(...) syntax is supported. However passing the URL of the endpoint seems to work just fine as well.

Thanks!


Hypothesis requires to be loaded in the main-app html element

Angular works under the main-app html element. Hypothesis needs to be loaded loaded everytime app is updated. Since we are reloading upon every link redirection, it is enough to embed hypothesis in the main-app

Done


Can't pass strings as inputs

I have a net that does some string processing as it's first step, that works with the deprecated wrapper, but not with this (very nice looking) library
model = Sequential(
  [
      layers.Input(shape=(1,), dtype=tf.string),
      text_vectorizer,
      layers.Embedding(max_features + 1, 50 * multiplier),
      layers.Dropout(.1),
      layers.GlobalAveragePooling1D(),
      layers.Dropout(.1),
      layers.Dense(20, kernel_initializer=initializers.random_uniform, activation=activations.swish),
   ]
)

Traceback

---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
File ~/Library/Caches/pypoetry/virtualenvs/tensorflow-part-2-JIKxCiSF-py3.10/lib/python3.10/site-packages/sklearn/utils/validation.py:787, in check_array(array, accept_sparse, accept_large_sparse, dtype, order, copy, force_all_finite, ensure_2d, allow_nd, ensure_min_samples, ensure_min_features, estimator)
    786 try:
--> 787     array = array.astype(np.float64)
    788 except ValueError as e:
ValueError: could not convert string to float: 'two fires american indians civil war laurence hauptman reveals several hundred thousand indians affected civil war twenty thousand indians enlisted sides attempt gain legitimacy autonomy simply land'
The above exception was the direct cause of the following exception:
ValueError                                Traceback (most recent call last)
Input In [28], in
9 classifier = KerasClassifier(X=feature.values.astype(np.str_), y=label.values, model=make_model, batch_size=-1, validation_split=.2, verbose=1, sample_weight=1, )
10 grid = GridSearchCV(
11     estimator=classifier,
12     param_grid={},
13     verbose=1,
14 )
---> 15 grid_result = grid.fit(feature.values.astype(np.str_), label.values, callbacks=[callback], verbose=1)
16 history = grid_result.history_
18 grid_result
File ~/Library/Caches/pypoetry/virtualenvs/tensorflow-part-2-JIKxCiSF-py3.10/lib/python3.10/site-packages/sklearn/model_selection/search.py:926, in BaseSearchCV.fit(self, X, y, groups, **fit_params)
924 refit_start_time = time.time()
925 if y is not None:
--> 926     self.best_estimator.fit(X, y, **fit_params)
927 else:
928     self.best_estimator_.fit(X, **fit_params)
File ~/Library/Caches/pypoetry/virtualenvs/tensorflow-part-2-JIKxCiSF-py3.10/lib/python3.10/site-packages/scikeras/wrappers.py:523, in BaseWrapper.fit(self, X, y, sample_weight, warm_start, **kwargs)
520 else:
521     # No warm start requested
522     reset = True
--> 523 X, y = self._validate_data(X=X, y=y, reset=reset)
525 if sample_weight is not None:
526     sample_weight = _check_sample_weight(
527         sample_weight, X, dtype=["float64", "int"]
528     )
File ~/Library/Caches/pypoetry/virtualenvs/tensorflow-part-2-JIKxCiSF-py3.10/lib/python3.10/site-packages/scikeras/wrappers.py:383, in BaseWrapper._validate_data(self, X, y, reset)
363 """Validate input data and set or check the n_features_in_ attribute.
364 Parameters
365 ----------
(...)
380     The validated input. A tuple is returned if y is not None.
381 """
382 if y is not None:
--> 383     X, y = check_X_y(
384         X,
385         y,
386         allow_nd=True,  # allow X to have more than 2 dimensions
387         multi_output=True,  # allow y to be 2D
388     )
389 X = check_array(X, allow_nd=True, dtype=["float64", "int"])
391 n_features = X.shape[1]
File ~/Library/Caches/pypoetry/virtualenvs/tensorflow-part-2-JIKxCiSF-py3.10/lib/python3.10/site-packages/sklearn/utils/validation.py:964, in check_X_y(X, y, accept_sparse, accept_large_sparse, dtype, order, copy, force_all_finite, ensure_2d, allow_nd, multi_output, ensure_min_samples, ensure_min_features, y_numeric, estimator)
961 if y is None:
962     raise ValueError("y cannot be None")
--> 964 X = check_array(
965     X,
966     accept_sparse=accept_sparse,
967     accept_large_sparse=accept_large_sparse,
968     dtype=dtype,
969     order=order,
970     copy=copy,
971     force_all_finite=force_all_finite,
972     ensure_2d=ensure_2d,
973     allow_nd=allow_nd,
974     ensure_min_samples=ensure_min_samples,
975     ensure_min_features=ensure_min_features,
976     estimator=estimator,
977 )
979 y = _check_y(y, multi_output=multi_output, y_numeric=y_numeric)
981 check_consistent_length(X, y)
File ~/Library/Caches/pypoetry/virtualenvs/tensorflow-part-2-JIKxCiSF-py3.10/lib/python3.10/site-packages/sklearn/utils/validation.py:789, in check_array(array, accept_sparse, accept_large_sparse, dtype, order, copy, force_all_finite, ensure_2d, allow_nd, ensure_min_samples, ensure_min_features, estimator)
787         array = array.astype(np.float64)
788     except ValueError as e:
--> 789         raise ValueError(
790             "Unable to convert array of bytes/strings "
791             "into decimal numbers with dtype='numeric'"
792         ) from e
793 if not allow_nd and array.ndim >= 3:
794     raise ValueError(
795         "Found array with dim %d. %s expected <= 2."
796         % (array.ndim, estimator_name)
797     )
ValueError: Unable to convert array of bytes/strings into decimal numbers with dtype='numeric'

There's also a bunch of related warnings
/Users/billie/Library/Caches/pypoetry/virtualenvs/tensorflow-part-2-JIKxCiSF-py3.10/lib/python3.10/site-packages/sklearn/utils/validation.py:964: FutureWarning: Arrays of bytes/strings is being converted to decimal numbers if dtype='numeric'. This behavior is deprecated in 0.24 and will be removed in 1.1 (renaming of 0.26). Please convert your data to numeric values explicitly instead.
  X = check_array(
/Users/billie/Library/Caches/pypoetry/virtualenvs/tensorflow-part-2-JIKxCiSF-py3.10/lib/python3.10/site-packages/sklearn/model_selection/_validation.py:372: FitFailedWarning:
5 fits failed out of a total of 5.

Version
[[package]]
name = "scikeras"
version = "0.1.8"
description = "Scikit-Learn API wrappers for Keras."
category = "main"
optional = false
python-versions = ">=3.6"

I have noticed that the latest version is "v0.5.1" I am going to see what's preventing me from upgrading, and I'll re-open if that's not it

We do some preprocessing that the old wrappers don't do, namely calling sklearn's check{X,y} functions that mirrors what other sklearn estimators do internally and increases compatibility.
But it looks like one of these doesn't like your string input, I'm just not sure where things are going wrong since there's a lot of layers to work with here (sklearn, scikeras, Keras, tensorflow).
Would you mind providing a minimally reproducible example, ideally with 1 row of input data so that I can debug locally and figure out where things are going wrong?

Here we go, this is the the word embeddings tutorial cut down. First we run the model to prove it works with plain keras, then we do the same thing with a grid search attempting to find if 15 or 16 epoch is optimum.
https://gist.github.com/PurpleBooth/ee3a528da422b31131b708d36d5d3eb9

Here's my WIP notebook. I think this reproduces your error right @PurpleBooth ? https://colab.research.google.com/drive/19CuuFhshTpjZ1HGl99sp6mFw7UFHr5F8?usp=sharing

I had already switched to doing the tokenisation outside the network to get it working, so it's not a big deal, but I think perhaps a note in the migration doc is warranted though, since it's a breaking change between the two APIs

Yeah fair enough, I'll keep this issue open until I make that change!


Fix #26115: Setup discriminator parameter corruption

The setup discriminator parameter is being passed by reference, but by the time the block is run by dispatch, that reference points to stack contents that have been changed.  Making a local copy of the discriminator fixes the problem.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Fast-tracking platform-specific change with platform owner review.

@rob-the-dude Thank you again for finding this and for the PR!


follow the guide about openstack part, the cli can not work

I tried the guide doc as https://github.com/emccode/rexray
and https://github.com/emccode/rexray/blob/master/.docs/user-guide/openstack.md
the config file as below

cat  /etc/rexray/config.yml
openstack:
authURL:              http://identity-ip:5000/v2.0
userID:               0
userName:             admin
password:             password
tenantID:             0
tenantName:           admin
domainID:             0
domainName:           corp
regionName:           RegionOne
availabilityZoneName: nova
storageDrivers:

openstack

Then the cli would get following errors:
$ rexray volume get
Oops, an error occured!
no storage drivers initialized
To correct the error please review:

Debug output by using the flag -l debug
The REX-ray website at https://github.com/emccode/rexray
The on?.ne he?. be?.w

Get one or more volumes
Usage:
rexray volume get [flags]
It seems doc is not good for new beginners or some issue for the rexray

Hello!
We are updating docs to include exact config files.
Here is a working example.  You can run this with rexray volume -l debug if you have issues to get more information.
storageDrivers:
    - openstack
openstack:
    authUrl: https://region-a.geo-1.identity.hpcloudsvc.com:35357/v2.0/
    tenantName:<PHONE_NUMBER>4544-Project
    regionName: region-a.geo-1
    username: clintonskitson
    password: blah

hi @clintonskitson  Thanks for you quick update. still hit erros like below:
DEBU[0000] updated log level                             logLevel=debug
DEBU[0000] error initializing driver                     driverName=Openstack error.provider=Openstack error.cmd.Path="/usr/sbin/dmidecode" error.cmd.Args=[/usr/sbin/dmidecode] error.cmd.Out=[35 32 100 109 105 100 101 99 111 100 101 32 50 46 49 50 10] error.message="error getting instance id"
INFO[0000] volume driver initialized                     provider=docker
INFO[0000] os driver initialized                         provider=linux
Oops, an error occured!
no storage drivers initialized

If you do "which dmidecode" is it available to the user you are rubbing
as?  Have you done a "apt-get install dmidecode"?  The user running RR for
OS must be able to access this binary.
On Monday, November 9, 2015, Kai Qiang Wu<EMAIL_ADDRESS>wrote:

hi @clintonskitson https://github.com/clintonskitson Thanks for you
quick update. still hit erros like below:
DEBU[0000] updated log level logLevel=debug
DEBU[0000] error initializing driver driverName=Openstack
error.provider=Openstack error.cmd.Path="/usr/sbin/dmidecode"
error.cmd.Args=[/usr/sbin/dmidecode] error.cmd.Out=[35 32 100 109 105 100
101 99 111 100 101 32 50 46 49 50 10] error.message="error getting instance
id"
INFO[0000] volume driver initialized provider=docker
INFO[0000] os driver initialized provider=linux
Oops, an error occured!
no storage drivers initialized
—
Reply to this email directly or view it on GitHub
https://github.com/emccode/rexray/issues/178#issuecomment-155240831.

Hi @clintonskitson
$ which dmidecode
/usr/sbin/dmidecode
My requirements like this:
From docker guide, it said
http://docs.docker.com/engine/extend/plugins/
I noticed rexray plugin can work with openstack.  We have openstack environment, so I want to test if it works with cinder intergration, which can make me operate docker like
$ docker run -ti -v volumename:/data --volume-driver=rexray(or openstack)   busybox sh
Is it possible ?  if not, how rexray works with openstack ?

Can you send me the output of dmidecode?
On Monday, November 9, 2015, Kai Qiang Wu<EMAIL_ADDRESS>wrote:

Hi @clintonskitson https://github.com/clintonskitson
$ which dmidecode
/usr/sbin/dmidecode
My requirements like this:
From docker guide, it said
http://docs.docker.com/engine/extend/plugins/
I noticed rexray plugin can work with openstack. We have openstack
environment, so I want to test if it works with cinder intergration, which
can make me operate docker like
$ docker run -ti -v volumename:/data --volume-driver=rexray(or openstack)
busybox sh
Is it possible ? if not, how rexray works with openstack ?
—
Reply to this email directly or view it on GitHub
https://github.com/emccode/rexray/issues/178#issuecomment-155245118.

hi @clintonskitson here is output
dmidecode 2.12
SMBIOS 2.4 present.
15 structures occupying 545 bytes.
Table at 0xDFFFFDD0.
Handle 0x0000, DMI type 0, 24 bytes
BIOS Information
Vendor: Seabios
Version: 0.5.1
Release Date: 01/01/2007
Address: 0xE8000
Runtime Size: 96 kB
ROM Size: 64 kB
Characteristics:
BIOS characteristics not supported
Targeted content distribution is supported
BIOS Revision: 1.0
Handle 0x0100, DMI type 1, 27 bytes
System Information
Manufacturer: IBM
Product Name: OpenStack Nova
Version: 2<IP_ADDRESS>-201412020041.ibm.el6.101
Serial Number: 309392a0-5264-e211-9f9c-6cae8b2ab1e8
UUID: A460F6DD-8F4C-48A6-8705-3D206DF66F93
Wake-up Type: Power Switch
SKU Number: Not Specified
Family: Red Hat Enterprise Linux
Handle 0x0300, DMI type 3, 20 bytes
Chassis Information
Manufacturer: Red Hat
Type: Other
Lock: Not Present
Version: Not Specified
Serial Number: Not Specified
Asset Tag: Not Specified
Boot-up State: Safe
Power Supply State: Safe
Thermal State: Safe
Security Status: Unknown
OEM Information: 0x00000000
Height: Unspecified
Number Of Power Cords: Unspecified
Handle 0x0401, DMI type 4, 32 bytes
Processor Information
Socket Designation: CPU 1
Type: Central Processor
Family: Other
Manufacturer: Bochs
ID: A1 06 02 00 FF FB 8B 0F
Version: Not Specified
Voltage: Unknown
External Clock: Unknown
Max Speed: 2000 MHz
Current Speed: 2000 MHz
Status: Populated, Enabled
Upgrade: Other
L1 Cache Handle: Not Provided
L2 Cache Handle: Not Provided
L3 Cache Handle: Not Provided
Handle 0x0402, DMI type 4, 32 bytes
Processor Information
Socket Designation: CPU 2
Type: Central Processor
Family: Other
Manufacturer: Bochs
ID: A1 06 02 00 FF FB 8B 0F
Version: Not Specified
Voltage: Unknown
External Clock: Unknown
Max Speed: 2000 MHz
Current Speed: 2000 MHz
Status: Populated, Enabled
Upgrade: Other
L1 Cache Handle: Not Provided
L2 Cache Handle: Not Provided
L3 Cache Handle: Not Provided
Handle 0x0403, DMI type 4, 32 bytes
Processor Information
Socket Designation: CPU 3
Type: Central Processor
Family: Other
Manufacturer: Bochs
ID: A1 06 02 00 FF FB 8B 0F
Version: Not Specified
Voltage: Unknown
External Clock: Unknown
Max Speed: 2000 MHz
Current Speed: 2000 MHz
Status: Populated, Enabled
Upgrade: Other
L1 Cache Handle: Not Provided
L2 Cache Handle: Not Provided
L3 Cache Handle: Not Provided
Handle 0x0404, DMI type 4, 32 bytes
Processor Information
Socket Designation: CPU 4
Type: Central Processor
Family: Other
Manufacturer: Bochs
ID: A1 06 02 00 FF FB 8B 0F
Version: Not Specified
Voltage: Unknown
External Clock: Unknown
Max Speed: 2000 MHz
Current Speed: 2000 MHz
Status: Populated, Enabled
Upgrade: Other
L1 Cache Handle: Not Provided
L2 Cache Handle: Not Provided
L3 Cache Handle: Not Provided
Handle 0x1000, DMI type 16, 15 bytes
Physical Memory Array
Location: Other
Use: System Memory
Error Correction Type: Multi-bit ECC
Maximum Capacity: 8 GB
Error Information Handle: Not Provided
Number Of Devices: 1
Handle 0x1100, DMI type 17, 21 bytes
Memory Device
Array Handle: 0x1000
Error Information Handle: 0x0000
Total Width: 64 bits
Data Width: 64 bits
Size: 8192 MB
Form Factor: DIMM
Set: None
Locator: DIMM 0
Bank Locator: Not Specified
Type: RAM
Type Detail: None
Handle 0x1300, DMI type 19, 15 bytes
Memory Array Mapped Address
Starting Address: 0x00000000000
Ending Address: 0x000DFFFFFFF
Range Size: 3584 MB
Physical Array Handle: 0x1000
Partition Width: 1
Handle 0x1301, DMI type 19, 15 bytes
Memory Array Mapped Address
Starting Address: 0x00100000000
Ending Address: 0x0021FFFFFFF
Range Size: 4608 MB
Physical Array Handle: 0x1000
Partition Width: 1
Handle 0x1400, DMI type 20, 19 bytes
Memory Device Mapped Address
Starting Address: 0x00000000000
Ending Address: 0x000DFFFFFFF
Range Size: 3584 MB
Physical Device Handle: 0x1100
Memory Array Mapped Address Handle: 0x1300
Partition Row Position: 1
Handle 0x1401, DMI type 20, 19 bytes
Memory Device Mapped Address
Starting Address: 0x00100000000
Ending Address: 0x0021FFFFFFF
Range Size: 4608 MB
Physical Device Handle: 0x1100
Memory Array Mapped Address Handle: 0x1301
Partition Row Position: 1
Handle 0x2000, DMI type 32, 11 bytes
System Boot Information
Status: No errors detected
Handle 0x7F00, DMI type 127, 4 bytes
End Of Table

Okay so running rexray as the same user that you tan dmidecode as doesn't
work?
On Monday, November 9, 2015, Kai Qiang Wu<EMAIL_ADDRESS>wrote:

hi @clintonskitson https://github.com/clintonskitson here is output
dmidecode 2.12
SMBIOS 2.4 present.
15 structures occupying 545 bytes.
Table at 0xDFFFFDD0.
Handle 0x0000, DMI type 0, 24 bytes
BIOS Information
Vendor: Seabios
Version: 0.5.1
Release Date: 01/01/2007
Address: 0xE8000
Runtime Size: 96 kB
ROM Size: 64 kB
Characteristics:
BIOS characteristics not supported
Targeted content distribution is supported
BIOS Revision: 1.0
Handle 0x0100, DMI type 1, 27 bytes
System Information
Manufacturer: IBM
Product Name: OpenStack Nova
Version: 2<IP_ADDRESS>-201412020041.ibm.el6.101
Serial Number: 309392a0-5264-e211-9f9c-6cae8b2ab1e8
UUID: A460F6DD-8F4C-48A6-8705-3D206DF66F93
Wake-up Type: Power Switch
SKU Number: Not Specified
Family: Red Hat Enterprise Linux
Handle 0x0300, DMI type 3, 20 bytes
Chassis Information
Manufacturer: Red Hat
Type: Other
Lock: Not Present
Version: Not Specified
Serial Number: Not Specified
Asset Tag: Not Specified
Boot-up State: Safe
Power Supply State: Safe
Thermal State: Safe
Security Status: Unknown
OEM Information: 0x00000000
Height: Unspecified
Number Of Power Cords: Unspecified
Handle 0x0401, DMI type 4, 32 bytes
Processor Information
Socket Designation: CPU 1
Type: Central Processor
Family: Other
Manufacturer: Bochs
ID: A1 06 02 00 FF FB 8B 0F
Version: Not Specified
Voltage: Unknown
External Clock: Unknown
Max Speed: 2000 MHz
Current Speed: 2000 MHz
Status: Populated, Enabled
Upgrade: Other
L1 Cache Handle: Not Provided
L2 Cache Handle: Not Provided
L3 Cache Handle: Not Provided
Handle 0x0402, DMI type 4, 32 bytes
Processor Information
Socket Designation: CPU 2
Type: Central Processor
Family: Other
Manufacturer: Bochs
ID: A1 06 02 00 FF FB 8B 0F
Version: Not Specified
Voltage: Unknown
External Clock: Unknown
Max Speed: 2000 MHz
Current Speed: 2000 MHz
Status: Populated, Enabled
Upgrade: Other
L1 Cache Handle: Not Provided
L2 Cache Handle: Not Provided
L3 Cache Handle: Not Provided
Handle 0x0403, DMI type 4, 32 bytes
Processor Information
Socket Designation: CPU 3
Type: Central Processor
Family: Other
Manufacturer: Bochs
ID: A1 06 02 00 FF FB 8B 0F
Version: Not Specified
Voltage: Unknown
External Clock: Unknown
Max Speed: 2000 MHz
Current Speed: 2000 MHz
Status: Populated, Enabled
Upgrade: Other
L1 Cache Handle: Not Provided
L2 Cache Handle: Not Provided
L3 Cache Handle: Not Provided
Handle 0x0404, DMI type 4, 32 bytes
Processor Information
Socket Designation: CPU 4
Type: Central Processor
Family: Other
Manufacturer: Bochs
ID: A1 06 02 00 FF FB 8B 0F
Version: Not Specified
Voltage: Unknown
External Clock: Unknown
Max Speed: 2000 MHz
Current Speed: 2000 MHz
Status: Populated, Enabled
Upgrade: Other
L1 Cache Handle: Not Provided
L2 Cache Handle: Not Provided
L3 Cache Handle: Not Provided
Handle 0x1000, DMI type 16, 15 bytes
Physical Memory Array
Location: Other
Use: System Memory
Error Correction Type: Multi-bit ECC
Maximum Capacity: 8 GB
Error Information Handle: Not Provided
Number Of Devices: 1
Handle 0x1100, DMI type 17, 21 bytes
Memory Device
Array Handle: 0x1000
Error Information Handle: 0x0000
Total Width: 64 bits
Data Width: 64 bits
Size: 8192 MB
Form Factor: DIMM
Set: None
Locator: DIMM 0
Bank Locator: Not Specified
Type: RAM
Type Detail: None
Handle 0x1300, DMI type 19, 15 bytes
Memory Array Mapped Address
Starting Address: 0x00000000000
Ending Address: 0x000DFFFFFFF
Range Size: 3584 MB
Physical Array Handle: 0x1000
Partition Width: 1
Handle 0x1301, DMI type 19, 15 bytes
Memory Array Mapped Address
Starting Address: 0x00100000000
Ending Address: 0x0021FFFFFFF
Range Size: 4608 MB
Physical Array Handle: 0x1000
Partition Width: 1
Handle 0x1400, DMI type 20, 19 bytes
Memory Device Mapped Address
Starting Address: 0x00000000000
Ending Address: 0x000DFFFFFFF
Range Size: 3584 MB
Physical Device Handle: 0x1100
Memory Array Mapped Address Handle: 0x1300
Partition Row Position: 1
Handle 0x1401, DMI type 20, 19 bytes
Memory Device Mapped Address
Starting Address: 0x00100000000
Ending Address: 0x0021FFFFFFF
Range Size: 4608 MB
Physical Device Handle: 0x1100
Memory Array Mapped Address Handle: 0x1301
Partition Row Position: 1
Handle 0x2000, DMI type 32, 11 bytes
System Boot Information
Status: No errors detected
Handle 0x7F00, DMI type 127, 4 bytes
End Of Table
—
Reply to this email directly or view it on GitHub
https://github.com/emccode/rexray/issues/178#issuecomment-155248440.

yes, @clintonskitson it can not work, I run both as normal user and root, neither can work.
Could you share how to make rexray work with openstack ?

Also @clintonskitson  I am not sure why need dmidecode run with rexray.
Right now, docker can work. rexray seems not work

If you run "rexray volume -l debug" are you getting the same error when
running as root?
Getting past this error will likely get it working for you.  Trying to
collect more details as to the instance id problem you are hitting.  We
have an open bug to enhance error reporting for OS, so I may need to give
you a special build for now to troubleshoot as to why it is having a
problem.
On Monday, November 9, 2015, Kai Qiang Wu<EMAIL_ADDRESS>wrote:

yes, @clintonskitson https://github.com/clintonskitson it can not work,
I run both as normal user and root, neither can work.
Could you share how to make rexray work with openstack ?
—
Reply to this email directly or view it on GitHub
https://github.com/emccode/rexray/issues/178#issuecomment-155255446.

The "dmidecode" grabs the instance ID of your VM.  This is critical so we
can tell RR what instance to attach new volumes to.  Without this RR
doesn't know where to send volumes when requested.
On Monday, November 9, 2015, Clinton Kitson<EMAIL_ADDRESS>wrote:

If you run "rexray volume -l debug" are you getting the same error when
running as root?
Getting past this error will likely get it working for you.  Trying to
collect more details as to the instance id problem you are hitting.  We
have an open bug to enhance error reporting for OS, so I may need to give
you a special build for now to troubleshoot as to why it is having a
problem.
On Monday, November 9, 2015, Kai Qiang Wu<EMAIL_ADDRESS><javascript:_e(%7B%7D,'cvml','notifications@github.com');>> wrote:

yes, @clintonskitson https://github.com/clintonskitson it can not
work, I run both as normal user and root, neither can work.
Could you share how to make rexray work with openstack ?
—
Reply to this email directly or view it on GitHub
https://github.com/emccode/rexray/issues/178#issuecomment-155255446.

Hi @clintonskitson

here is run as root, for RR command;
$ sudo rexray volume -l debug
DEBU[0000] updated log level                             logLevel=debug
DEBU[0000] error initializing driver                     driverName=Openstack error.provider=Openstack error.cmd.Path="/usr/bin/xenstore-read" error.cmd.Args=[/usr/bin/xenstore-read vm-data/provider_data/region] error.cmd.Out=[] error.message="error getting instance region"
INFO[0000] volume driver initialized                     provider=docker
INFO[0000] os driver initialized                         provider=linux
Oops, an error occured!

no storage drivers initialized
2 Also  your above comments seems something need to discuss following case:
I have a openstack environment, for example server: <IP_ADDRESS>
I have a docker server : <IP_ADDRESS>
in docker server, I run rexray, and I configure storagedriver and openstack environment here.
Does rexray support this general environment ?
You said RR get instance ID from dmidecode command, and then attach volume to this instance,
and then docker volume command can use that volume, But openstack cinder volume lives on <IP_ADDRESS>, your RR service seems can not directly attach volume to <IP_ADDRESS>, does RR use iscsi tools or something else ?

Progress.. Now it looks like the regionname isn't being specified in the
config file.  If so it would not error on this region part.
RR should run on the docker server.  It then communicates with cinder to
orchestrate adding volumes to the docker instance.
On Monday, November 9, 2015, Kai Qiang Wu<EMAIL_ADDRESS>wrote:

Hi @clintonskitson https://github.com/clintonskitson

here is run as root, for RR command;
$ sudo rexray volume -l debug
DEBU[0000] updated log level logLevel=debug
DEBU[0000] error initializing driver driverName=Openstack
error.provider=Openstack error.cmd.Path="/usr/bin/xenstore-read"
error.cmd.Args=[/usr/bin/xenstore-read vm-data/provider_data/region]
error.cmd.Out=[] error.message="error getting instance region"
INFO[0000] volume driver initialized provider=docker
INFO[0000] os driver initialized provider=linux
Oops, an error occured!

no storage drivers initialized
2 Also your above comments seems something need to discuss following case:
I have a openstack environment, for example server: <IP_ADDRESS>
I have a docker server : <IP_ADDRESS>
in docker server, I run rexray, and I configure storagedriver and
openstack environment here.
Does rexray support this general environment ?
You said RR get instance ID from dmidecode command, and then attach volume
to this instance,
and then docker volume command can use that volume, But openstack cinder
volume lives on <IP_ADDRESS>, your RR service seems can not directly
attach volume to <IP_ADDRESS>, does RR use iscsi tools or something else ?
—
Reply to this email directly or view it on GitHub
https://github.com/emccode/rexray/issues/178#issuecomment-155257951.

@clintonskitson
openstack:
authURL:              http://<IP_ADDRESS>:5000/v2.0
userName:             admin
password:             password
tenantName:           admin
regionName:           RegionOne
availabilityZoneName: nova
regionename is specified

@HackToday My fault here, I gave you the new format of the config file for v3.
StorageDrivers:
 - openstack
OpenstackAuthUrl: https://region-a.geo-1.identity.hpcloudsvc.com:35357/v2.0/
OpenstackTenantName:<PHONE_NUMBER>4544-Project
OpenstackRegionName: region-a.geo-1
OpenstackUsername: clintonskitson
OpenstackPassword: pw

Hi @clintonskitson  according to your above change, I tried get following:
$ sudo rexray volume -l debug
DEBU[0000] updated log level                             logLevel=debug
INFO[0000] volume driver initialized                     provider=docker
INFO[0000] os driver initialized                         provider=linux
DEBU[0000] error initializing driver                     driverName=Openstack error=Error: dial tcp <IP_ADDRESS>:80: i/o timeout
Oops, an error occured!

Specify OpenstackAvailabilityZoneName and you should be good so it doesn't try and look it up.

Thanks @clintonskitson it did can get results now, but the issue for
$ sudo rexray service start
Starting REX-Ray...SUCESS!
$ sudo docker run -ti --volume-driver=rexray -v test:/test busybox
Error response from daemon: Plugin Error: VolumeDriver.Create, {"Error":"error getting driver instance"}

Try rexray volume -l debug.
On Mon, Nov 9, 2015 at 7:03 PM, Kai Qiang Wu<EMAIL_ADDRESS>wrote:

Thanks @clintonskitson https://github.com/clintonskitson it did can get
results now, but the issue for
$ sudo rexray service start
Starting REX-Ray...SUCESS!
$ sudo docker run -ti --volume-driver=rexray -v test:/test busybox
Error response from daemon: Plugin Error: VolumeDriver.Create,
{"Error":"error getting driver instance"}
—
Reply to this email directly or view it on GitHub
https://github.com/emccode/rexray/issues/178#issuecomment-155269160.

Hi @clintonskitson rexray volume can work (as said :) above )
$ sudo rexray volume -l debug
DEBU[0000] updated log level                             logLevel=debug
INFO[0000] storage driver initialized                    provider=Openstack
INFO[0000] volume driver initialized                     provider=docker
INFO[0000] os driver initialized                         provider=linux

name: k8sbay-rrpxyj5mdyqp-kube_minions-r3taoivuiqp5-0-dugpbsrwtsvz-docker_volume-mgxn6adbyjom
volumeid: 5b727c81-8afc-4038-83bb-a6f627cc8940
availabilityzone: nova
status: in-use
volumetype: lvmdriver-1
iops: 0
size: "4"
networkname: ""
attachments:

volumeid: 5b727c81-8afc-4038-83bb-a6f627cc8940
instanceid: 502db7fb-c2ed-44a0-a2ac-9f7180fd22dc
devicename: /dev/vdb
status: ""

The
$ sudo docker run -ti --volume-driver=rexray -v test:/test busybox
Error response from daemon: Plugin Error: VolumeDriver.Create, {"Error":"error getting driver instance"}
failed

You can try the process manually first before you run it from docker.
rexray volume create --volumename=testing --size=1
rexray volume mount --volumename=testing
On Mon, Nov 9, 2015 at 7:06 PM, Kai Qiang Wu<EMAIL_ADDRESS>wrote:

Hi @clintonskitson https://github.com/clintonskitson rexray volume can
work (as said :) above )
$ sudo rexray volume -l debug
DEBU[0000] updated log level logLevel=debug
INFO[0000] storage driver initialized provider=Openstack
INFO[0000] volume driver initialized provider=docker
INFO[0000] os driver initialized provider=linux

name:
k8sbay-rrpxyj5mdyqp-kube_minions-r3taoivuiqp5-0-dugpbsrwtsvz-docker_volume-mgxn6adbyjom
volumeid: 5b727c81-8afc-4038-83bb-a6f627cc8940 availabilityzone: nova
status: in-use volumetype: lvmdriver-1 iops: 0 size: "4" networkname: ""
attachments:

volumeid: 5b727c81-8afc-4038-83bb-a6f627cc8940 instanceid:
502db7fb-c2ed-44a0-a2ac-9f7180fd22dc devicename: /dev/vdb status: ""

The
$ sudo docker run -ti --volume-driver=rexray -v test:/test busybox
Error response from daemon: Plugin Error: VolumeDriver.Create,
{"Error":"error getting driver instance"}
failed
—
Reply to this email directly or view it on GitHub
https://github.com/emccode/rexray/issues/178#issuecomment-155269471.

hi @clintonskitson  I am not sure what do you mean manually first.
I tried
$ sudo  rexray volume create --volumename="myvoltest" --size=1
name: myvoltest
volumeid: 0a9c53b7-97f2-4369-8d62-43a2885c6be8
availabilityzone: nova
status: available
volumetype: lvmdriver-1
iops: 0
size: "1"
networkname: ""
attachments: []
It works, but my final goal is to make docker cli can work with rexray driver
$ docker volume create   --driver rexray
Error response from daemon: Plugin Error: VolumeDriver.Create, {"Error":"error getting driver instance"}
Could you specify what manual steps to debug that ?

@HackToday Sorry about that, my phone didn't send the steps that I had listed.  The bug that you hit in https://github.com/emccode/rexray/issues/179 is another issue.
These would be the steps I was referencing.  But the attach commands you did in the other issue will yield the same panic I believe.
rexray volume create --volumename=test --size=1
rexray volume mount --volumename=test

$ sudo rexray volume create --volumename=test --size=1
name: test
volumeid: c64c5a74-c1b6-4e0f-a7f0-e3fb64ed25a2
availabilityzone: nova
status: available
volumetype: lvmdriver-1
iops: 0
size: "1"
networkname: ""
attachments: []
$ sudo rexray volume -l debug mount --volumename=test
DEBU[0000] updated log level                             logLevel=debug
INFO[0000] volume driver initialized                     provider=docker
INFO[0000] os driver initialized                         provider=linux
INFO[0000] storage driver initialized                    provider=Openstack
INFO[0000] mounting volume                               driverName=docker newFsType= overwriteFs=false volumeID= volumeName=test
FATA[0001] error getting driver instance
Hi @clintonskitson  the above not give any details what's error about ?
Could you tell me how would you make rexray work with openstack ? what's your openstack environment look like ?

hi @clintonskitson  it seems the github process is slow. :). Or not sure if you have IRC channel.
do you know how to build rexray myself ? I want to debug the source code and find the issue

Check our main page here, there is a slack logo on the right.  Once you join the slack community, there is a channel for #project-rexray.
http://emccode.github.io/
git clone https://github.com/emccode/rexray
go get https://github.com/Masterminds/glide
cd rexray
glide up
make

Can you describe your devstack setup a bit more, or the steps you used to set it up and version?

@clintonskitson Hi for devstack, just follow docs.openstack.org/developer/devstack to setup all-in-one enviroment.Did you have a devstack environment ?

@clintonskitson  even you provided instrction
$ go get https://github.com/Masterminds/glide
package https:/github.com/Masterminds/glide: "https://" not allowed in import path

go get github.com/Masterminds/glide

thanks @clintonskitson for help to make it work. It seems we need update some guides which was obslete , like openstack configuration in config.yml format.

Thanks for the feedback, we will definitely have examples with the 0.3 release upcoming.  Please close if you are satisfied for now.
Aside from docs, the resolution to this was that REX-Ray wasn't being ran from an instance being deployed by OpenStack.

yes, rexray needto  install on deployed openstack instances.


MoneyItemField value not updating on item update

Updating a money field on an item doesn't update the value.  The value is set to $0 and does not reflect the value that it was supposed to be updated to.  Two fields should be updated, only the category field is updated and the money field isn't.
var updateItem = new PodioAPI.Models.Item();
var jobValueField = updateItem.Field<MoneyItemField>("job-value");
jobValueField.Currency = "AUD";
jobValueField.Value = 20.0000M;
var statusField = updateItem.Field<CategoryItemField>("job-status");
statusField.OptionId = 1; //Id comes from option mapping
updateItem.ItemId = podioJobsItem.ItemId; //Item Id comes from foreach
clientJobs.ItemService.UpdateItemFieldValues(updateItem)

Hi @jshoey
That is not working because you are using UpdateItemFieldValues method in ItemService , which is used to update only one field (specifed in xml documentation for that method). Please use UpdateItemValues or UpdateItem method to update multiple fields in of an item.


Password Encryption & Testing all the functionalities.

Resolution for #63
createdAt and updatedAt have been added to user db across all the apps.
Testing API behavior for all the apps.

Changes implemented

initialData object was being used in all the apps. However, this approach would update all the instances (since its reference is the same object).
On most of the controller functions, schema is passed as 1st parameter but hasn't been used. I have replaced this.db.[model] calls to schema.[model]. By doing so, we could avoid eslint issues too.
Addition of createdAt and updatedAt in apps

[Do not merge the PR]

Discarding this PR.
Individual Project PRs are raised.


Select name space for new command

When creating a new command, a namespace has to be selected. I unfortunately usually don't remember the exact spelling or name of my namespaces. It would be great to either get a suggestion when typing or being able to navigate through the existing ones using the arrow keys.

Implemented with Release 1.4.1


add license files

plse add the mit license and apache license into the repo and crate. thanks. Need them for packaging in fedora

Ok! Fixed in https://github.com/faern/oneshot/commit/2d12377ff67b6721ad62eb57ff564ce09d661cf9

oh, and remember to add them to cargo.toml!

Why? The license is already explicitly stated in Cargo.toml. Can you point to some documentation that what you propose is best practice?

Not adding them to Cargo.toml, just make sure they are in the .crate which should automatically be the case. Would be nice if you could exclude check_mem_leaks.sh (and maybe .github) though. Not crucial, it's just something that when packaging to Fedora we have to remove to avoid introducing an artificial dependency on bash.


GenerateTypeAdapter proguard warning

Updated to 0.7.0 and got this proguard warnings related to the new annotation @GenerateTypeAdapter. I haven't used it yet so I'm not really sure.
Here's the proguard warning
Warning: library class com.ryanharter.auto.value.gson.GenerateTypeAdapter$1 extends or implements program class com.google.gson.TypeAdapterFactory

Warning: there were 1 instances of library classes depending on program classes.
         You must avoid such dependencies, since the program classes will
         be processed, while the library classes will remain unchanged.

Here's my dependencies
depedencies {
    //...
    compileOnly "com.jakewharton.auto.value:auto-value-annotations:$project.ext.autoValueAnnotationsVersion"
    compileOnly "com.ryanharter.auto.value:auto-value-gson:$project.ext.autoValueGsonVersion"
    annotationProcessor "com.google.auto.value:auto-value:$project.ext.autoValueVersion"
    annotationProcessor "com.ryanharter.auto.value:auto-value-gson:$project.ext.autoValueGsonVersion"
    annotationProcessor "com.ryanharter.auto.value:auto-value-parcel:$project.ext.autoValueParcelVersion"
    //...
}

For now I simply ignored the warnings by adding the following rules:
-dontwarn com.ryanharter.auto.value.gson.GenerateTypeAdapter
-dontwarn com.google.gson.TypeAdapterFactory

Do you have a Gson dependency?
On Sun, Dec 31, 2017, 9:51 AM Miguel Fermin<EMAIL_ADDRESS>wrote:

Updated to 0.7.0 and got this proguard warnings when i build a signed apk.
Warning: library class com.ryanharter.auto.value.gson.GenerateTypeAdapter$1 extends or implements program class com.google.gson.TypeAdapterFactory
Warning: there were 1 instances of library classes depending on program classes.
You must avoid such dependencies, since the program classes will
be processed, while the library classes will remain unchanged.
Here's my depedencies
depedencies {
//...
compileOnly "com.jakewharton.auto.value:auto-value-annotations:$project.ext.autoValueAnnotationsVersion"
compileOnly "com.ryanharter.auto.value:auto-value-gson:$project.ext.autoValueGsonVersion"
annotationProcessor "com.google.auto.value:auto-value:$project.ext.autoValueVersion"
annotationProcessor "com.ryanharter.auto.value:auto-value-gson:$project.ext.autoValueGsonVersion"
annotationProcessor "com.ryanharter.auto.value:auto-value-parcel:$project.ext.autoValueParcelVersion"
//...
}
For now I ignored the warnings by adding the following rules:
-dontwarn com.ryanharter.auto.value.gson.GenerateTypeAdapter
-dontwarn com.google.gson.TypeAdapterFactory
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/rharter/auto-value-gson/issues/162, or mute the
thread
https://github.com/notifications/unsubscribe-auth/AAEEEQDEtXXlyHeOAoKSj7B4cAMf5yK2ks5tF59dgaJpZM4RP3aW
.

Yes, I have a Gson dependency.

Closing this out, but the rules above should suffice. Unfortunately we can't solve this with an embedded proguard file as these would be compileOnly and presumably not reach proguard/R8 tools to index on


#299 travis ci build status is broken

For #299

fixed malformed xsl and broken test

@dmzaytsev it should look like [file size] date

@dmzaytsev thanks.

@dmzaytsev updated response.

this screenshot from my local instance

@dmzaytsev thanks.

@dmzaytsev Thanks for your pull request, let me find someone who can review it

@krzyk review it

@rultor merge pls

@rultor merge pls

@krzyk Thanks for your request. @yegor256 Please confirm this.

@rultor merge it

@rultor merge it

@yegor256 OK, I'll try to merge now. You can check the progress of the merge here

@rultor merge it

@yegor256 Done! FYI, the full log is here (took me 7min)

@krzyk I added 16 mins to your account, many thanks for working with the project! The completion time here was 58535560.; you're getting extra minutes here (c=1); +16 added to your rating, current score is: +4631

@rultor deploy

@rultor deploy

@karato OK, I'll try to deploy now. You can check the progress here

@rultor deploy

@karato Done! FYI, the full log is here (took me 6min)


Invalid partition number XXXX specified for index with Increased Partitions Enabled

We are using the latest version of IndexOptimize to reorganize and rebuild our indexes however we have a table 1500 partitions which this script is failing on. I have increased the number of allowed partitions to 15,000 and can now rebuild the indexes manually via the GUI, or by running an ALTER INDEX statement, but the IndexOptimize fails. Interestingly however this surpasses 1001 to 1009 before it fails.
We are running SQL 2008 R2 Entperprise
The script was downloaded from the ola.hallengren.com website on the 8th January 2019
The following is the command being executed by the script and the output in the error log.
Command: ALTER INDEX [IX_xxxxxxxxxx] ON [Database].[Schema].[Table] REORGANIZE PARTITION = 1010 WITH (LOB_COMPACTION = ON) [SQLSTATE 01000]
Comment: ObjectType: Table, IndexType: NonClustered, ImageText: No, NewLOB: No, FileStream: No, AllowPageLocks: Yes, PageCount: 4278, Fragmentation: 99.9766 [SQLSTATE 01000]
Msg 50000, Sev 16, State 1, Line 192 : Msg 7722, Invalid partition number 1010 specified for index 'IX_ xxxxxxxxxx, partition number can range from 1 to 1000. [SQLSTATE 42000]

Exact same Problem here.

Could you try running this command in SSMS:
ALTER INDEX [IX_xxxxxxxxxx] ON [Database].[Schema].[Table] REORGANIZE PARTITION = 1010 WITH (LOB_COMPACTION = ON)

I'm about to enable 15k partition support on an old 2008R2 database that we use IndexOptimize on. Is this an issue still? Sorry, I know this is an old thread.

Hi sorry as this is an old thread I’ve not kept up with so apologise to everyone and @olahallengren. I had left the company I was working for in October 2019 and never got to implement anything to fix this.


Jira Collecor data not getting populated in UI

I can see the list of projects in the dropdown while configuring the feature widget. But the iteration details are getting populated as 0 0 0.
.
Please help me to resolve this issue
Following is my property file
Database Name
dbname=dashboarddb
Database HostName - default is localhost
dbhost=localhost
Database Port - default is 27017
dbport=27017
MongoDB replicaset
dbreplicaset=false
dbhostport=localhost:27017
Database Username - default is blank
dbusername=
Database Password - default is blank
dbpassword=
Logging File location
logging.file=./logs/jira.log
PageSize - Expand contract this value depending on Jira implementation's
default server timeout setting (You will likely receive a SocketTimeoutException)
feature.pageSize=100
Delta change date that modulates the collector item task
Occasionally, these values should be modified if database size is a concern
feature.deltaStartDate=2016-03-01T00:00:00.000000
feature.masterStartDate=2016-03-01T00:00:00.000000
feature.deltaCollectorItemStartDate=2016-03-01T00:00:00.000000
Chron schedule: S M D M Y [Day of the Week]
feature.cron=0 * * * * *
ST Query File Details - Required, but DO NOT MODIFY
feature.queryFolder=jiraapi-queries
feature.storyQuery=story
feature.epicQuery=epic
JIRA CONNECTION DETAILS:
Enterprise Proxy - ONLY INCLUDE IF YOU HAVE A PROXY
#feature.jiraProxyUrl=http://proxy.com
#feature.jiraProxyPort=9000
feature.jiraBaseUrl=http://xx.x.x.xxx.xx:8080/
feature.jiraQueryEndpoint=rest/api/2/
For basic authentication, requires username:password as string in base64
This command will make this for you:  echo -n username:password | base64
feature.jiraCredentials=***********************
OAuth is not fully implemented; please blank-out the OAuth values:
feature.jiraOauthAuthtoken=
feature.jiraOauthRefreshtoken=
feature.jiraOauthRedirecturi=
feature.jiraOauthExpiretime=
#############################################################################
In Jira, general IssueType IDs are associated to various 'issue'
attributes. However, there is one attribute which this collector's
queries rely on that change between different instantiations of Jira.
Please provide a string name reference to your instance's IssueType for
the lowest level of Issues (for example, 'user story') specific to your Jira
instance.  Note:  You can retrieve your instance's IssueType Name
listings via the following URI:  https://[your-jira-domain-name]/rest/api/2/issuetype/
Multiple comma-separated values can be specified.
#############################################################################
feature.jiraIssueTypeNames=Feature,Epic,Story
#############################################################################
In Jira, your instance will have its own custom field created for 'sprint' or 'timebox' details,
which includes a list of information.  This field allows you to specify that data field for your
instance of Jira. Note: You can retrieve your instance's sprint data field name
via the following URI, and look for a package name com.atlassian.greenhopper.service.sprint.Sprint;
your custom field name describes the values in this field:
https://[your-jira-domain-name]/rest/api/2/issue/[some-issue-name]
#############################################################################
feature.jiraSprintDataFieldName=
#############################################################################
In Jira, your instance will have its own custom field created for 'super story' or 'epic' back-end ID,
which includes a list of information.  This field allows you to specify that data field for your instance
of Jira.  Note:  You can retrieve your instance's epic ID field name via the following URI where your
queried user story issue has a super issue (for example, epic) tied to it; your custom field name describes the
epic value you expect to see, and is the only field that does this for a given issue:
https://[your-jira-domain-name]/rest/api/2/issue/[some-issue-name]
#############################################################################
feature.jiraEpicIdFieldName=
#############################################################################
In Jira, your instance will have its own custom field created for 'story points'
This field allows you to specify that data field for your instance
of Jira.  Note:  You can retrieve your instance's storypoints ID field name via the following URI where your
queried user story issue has story points set on it; your custom field name describes the
story points value you expect to see:
https://[your-jira-domain-name]/rest/api/2/issue/[some-issue-name]
#############################################################################
feature.jiraStoryPointsFieldName=
#############################################################################
In Jira, your instance will have its own custom field created for 'team'
This field allows you to specify that data field for your instance
of Jira.  Note:  You can retrieve your instance's team ID field name via the following URI where your
queried user story issue has team set on it; your custom field name describes the
team value you expect to see:
https://[your-jira-domain-name]/rest/api/2/issue/[some-issue-name]
#############################################################################
feature.jiraTeamFieldName=
Set this to true if you use boards as team
feature.jiraBoardAsTeam=false

@NeomiS1993 - can you please share your logs? I suspect you are getting 401 unauthorized. If so then you must add a hygieia user to your jira and use those credentials to authenticate.

Hi,
how do you solve this issue?

@matthewbeasley my logs showing no errors,but no data showing on UI.Thanks for your help.

Another finding ...In feature collection i don't have teamId=19508 which is populated by the jira collector whereas my team collection has 19508 for the selected team. I am not sure from where team collection is populated and how i can fix this. Since both ids are different it does not display the data. I am not sure what configuration can fix this issue.


Crash on startup due to no playlist image

Hey there,
I installed Spot via Flathub on Arch Linux.
I am running sway as a compositor with some gnome-services started manually.
Everything was working fine until after login, where the program crashed.
Launching now gives me the following stacktrace:
flatpak run --env=RUST_BACKTRACE=full dev.alextren.Spot
home
thread 'main' panicked at 'called `Option::unwrap()` on a `None` value', src/app/backend/api_models.rs:329:50
stack backtrace:
   0:     0x5569fae73230 - <unknown>
   1:     0x5569fae96cdc - <unknown>
   2:     0x5569fae6be12 - <unknown>
   3:     0x5569fae754d5 - <unknown>
   4:     0x5569fae7502a - <unknown>
   5:     0x5569fae75c71 - <unknown>
   6:     0x5569fae75787 - <unknown>
   7:     0x5569fae736ec - <unknown>
   8:     0x5569fae75719 - <unknown>
   9:     0x5569fae944f1 - <unknown>
  10:     0x5569fae9443d - <unknown>
  11:     0x5569fa68443e - <unknown>
  12:     0x5569fa6d58f7 - <unknown>
  13:     0x5569fa6b4b73 - <unknown>
  14:     0x5569fa737371 - <unknown>
  15:     0x5569fa72e87e - <unknown>
  16:     0x5569fa71f90c - <unknown>
  17:     0x5569fa710bae - <unknown>
  18:     0x5569fa671d64 - <unknown>
  19:     0x5569fae46785 - <unknown>
  20:     0x5569fae4809a - <unknown>
  21:     0x7f46befac40b - g_main_context_dispatch
  22:     0x7f46befac6b8 - <unknown>
  23:     0x7f46befac783 - g_main_context_iteration
  24:     0x7f46bf1d246d - g_application_run
  25:     0x5569fa6e085e - <unknown>
  26:     0x5569fa694408 - <unknown>
  27:     0x7f46befad535 - g_main_context_invoke_full
  28:     0x5569fa763589 - <unknown>
  29:     0x5569fa68d873 - <unknown>
  30:     0x5569fa656919 - <unknown>
  31:     0x5569fae76097 - <unknown>
  32:     0x5569fa7639c2 - main
  33:     0x7f46bec13062 - __libc_start_main
  34:     0x5569fa62613e - <unknown>
  35:                0x0 - <unknown>

Which appears to be an issue related to fetching the image of a playlist?
Not sure how to deal with this.

Fixed it. Had an empty playlist (which can be a thing in spotify, but I am not sure how I ended up with that), which therefor had no image.
The easy work-around would probably be to filter out such playlists (they do not provide much value), but it might be preferable to have some default art for the initialization of the PlaylistDescription.
Anyway, after deleting the playlist and clearing the cache of Spot, it works.

Hi,
Thanks for the detailed report!
Right, I should really not assume there to be at least one image :/ I knew that unwrap() was bad and yet I wrote it, shame on me! I'll look into making the URLs in these models Options.

I have this issue as well...instant crash on startup. My backtrace looks the same as @Drakulix

Anyway, after deleting the playlist and clearing the cache of Spot, it works.

Could you point me in the direction on how to clear the cache, please? I did try to delete the ~/.var/app/dev.alextren.Spot/cache but on restart it still dies. I am running the latest release 0.1.5.

I’ll push a fix ASAP, but in the meantime you can indeed try to clear the cache! The location you have is correct.
If the error persists, could you try removing the empty playlist from your account, the clear the cache? If you can’t, it might be still possible to fool the app: assuming you identify the playlist or albums that’s the culprit (we’re looking for something without a cover art), you could edit it’s cache entry to include some picture, or edit it out of the list of playlists/albums. If you have any details about the playlist or album involved I’ll be able to give you more detailed instructions.
Alternatively, you could try the latest build here : https://github.com/xou816/spot/suites/2062684952/artifacts/41648291 (x86 only)
sorry for the  trouble!

Anyway, after deleting the playlist and clearing the cache of Spot, it works.

Could you point me in the direction on how to clear the cache, please? I did try to delete the ~/.var/app/dev.alextren.Spot/cache but on restart it still dies. I am running the latest release 0.1.5.

Yes that is the right folder (at least for the flatpak variant).

All I can tell you is that this worked for me

Are you sure you deleted all problematic playlist before?

Thanx! I deleted maybe 10 empty lists but actually forgot one. :)
Now it seam to work!

Same issue here on Pop!_OS 20.10.
The suggested workaround works for me:

Delete empty playlist from Spotify
Delete everything under ~/.var/app/dev.alextren.Spot/cache/

What does empty playlist actually mean? I have a bunch of playlists that uses local data which isn't present on Spotify. Would these be considered empty as well? I really don't want to delete them either...

It's not so much the playlist being empty that's the issue, it's the playlist having no image, which can happen for multiple reasons, one being an empty playlist. If your playlist has an image, you should be fine :) please note that local tracks are not supported however (filtered out).
For those of you having this issue, could you try and see if using this snapshot build https://github.com/xou816/spot/suites/2062684952/artifacts/41648291 solves the issue? (avoids the crash at least) :) Thanks!

For those of you having this issue, could you try and see if using this snapshot build https://github.com/xou816/spot/suites/2062684952/artifacts/41648291 solves the issue? (avoids the crash at least) :) Thanks!

Worked like a charm :D

I had the same issue. I deleted an old playlist without image (I did it on open.spotify.com, as the official linux client crashed when I tried on it ...).
It fixed the problem too :+1:
Thanks !

fixed by 58a1db78e8c7cc8bbc54b635bde6214495f441da in 0.1.8 (unreleased)


cassowary: 0.14.0 -> 0.14.1

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://repology.org/metapackage/cassowary/versions.
meta.description for cassowary is: "Modern cross-platform HTTP load-testing tool written in Go"
meta.homepage for cassowary is: "https://github.com/rogerwelin/cassowary"
meta.changelog for cassowary is: ""
Updates performed

Golang update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 0.14.1 with grep in /nix/store/l0dh6gjvnznmvdqk4mxpvyq0yqxnhk8q-cassowary-0.14.1
found 0.14.1 in filename of file in /nix/store/l0dh6gjvnznmvdqk4mxpvyq0yqxnhk8q-cassowary-0.14.1

Rebuild report (if merged into master) (click to expand)

2 total rebuild path(s)

1 package rebuild(s)

1 x86_64-linux rebuild(s)
1 x86_64-darwin rebuild(s)

First fifty rebuilds by attrpath
cassowary

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/l0dh6gjvnznmvdqk4mxpvyq0yqxnhk8q-cassowary-0.14.1 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A cassowary https://github.com/r-ryantm/nixpkgs/archive/9a066d78a11be11245ae4ac13f6e5ad0703c57c7.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/l0dh6gjvnznmvdqk4mxpvyq0yqxnhk8q-cassowary-0.14.1
ls -la /nix/store/l0dh6gjvnznmvdqk4mxpvyq0yqxnhk8q-cassowary-0.14.1/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

cassowary

Maintainer pings
cc @hugoreeves @kalbasit for testing.

Result of nixpkgs-review pr 178949 run on x86_64-linux 1

1 package built:

cassowary


[opentitantool] do not create duplicate extension entries

It was observed that repetitive invoking 'opentitiantool image manifest update ...' passing an --spx_key and same manifest input file which included SPX key and signature extensions repetitively is causing addition of the SPX key and SPX signature space every time opentitantool is invoked.
This patch fixes the problem.
All opentitantool and opentitanlib tests pass, and running the same invocation does not cause additions of the SPX key and signature spaces any more.

fixes the previously discussed issue of uncontrollable image growth when passing the same manifest file to opentiatintool image manifest update ..

@pamaury @cfrantz any thought on this patch?
I think the fact that the image grows with each successive invocation when manifest json file is supplied is a problem which needs to be fixed.

I need to look at the code a bit more, I am not super familiar with the image manifest. Probably @cfrantz knows a lot more than me. My most immediate question is: what is opentitan manifest update supposed to do with key? Is it adding a new one or updating one? Do we even support manifests with more than one RSA/ECDSA/SPX keys?

I need to look at the code a bit more, I am not super familiar with the image manifest. Probably @cfrantz knows a lot more than me. My most immediate question is: what is opentitan manifest update supposed to do with key? Is it adding a new one or updating one? Do we even support manifests with more than one RSA/ECDSA/SPX keys?

Yes, we chatted about this with @cfrantz, what happens now is that once opentitantool was invoked with a manifest including SPX key and signature extensions, and the SPX key, the tool allocates room for the signature to adjust the total image size, filling up the signature space with 0xff. But if one invokes opentitantool again with the same manifest, another space for signature is added, and this repeats indefinitely, the size keeps increased by the SPX signature size on every invocation.


RuntimeError: CUDA Error encountered in <function CompiledLib.bn_forward_cuda at 0x7f2dfa433730>

Hi,
I'm trying to run Demo.ipynb but it breaks on the following line:
prediction = F.sigmoid(model(input_img)).data[0].cpu().numpy()

The error I get is below which I traced to line 16 of modules/functions.py
RuntimeError: CUDA Error encountered in <function CompiledLib.bn_forward_cuda at 0x7f2dfa433730>

Tracing the error, I see that it stems from conv2 = self.conv2(self.pool(conv1)) here.
I am not exactly sure how to fix it.
Kindly advise.

Hello,
I found that modifying the build.sh file as below solved the problem.  This is because certain codes are needed for certain gpus.
 Thanks!

Hard to tell. I believe I was using CUDA 9.0, but I am not sure that is is a requirement.
What CUDA version do you have installed?


fos 20 sec  change the channnel stream vlc  client user

when the user are conected to fos  ,,the duration of the streaming is 20 to 30 second after the vlc when the user is conected cchange the channel
not gooodddd fos panel havent sooooo meny bugggggggggggsssssssssss

I close this ticket, because you have more related tickets.


added gitlab-ci

I translated the github-actions into a gitlab-ci as best as I could

@bast can you have a look?

Thanks! What we can try later is to combine the pages into one and let participants switch between "tabs" but this can happen later. Thanks a lot!


heap analysis for tcmalloc

this not an issue as such. are there ways to know the all the  allocations made from of the central heap and the thread cache. or we need some pointers on how to locate the central heap, the thread cache locations and all allocations made from them in a core file.
we are thinking of writing gdb scripts in the lines similar to https://seanhn.wordpress.com/2011/03/30/heap-scripts-for-tcmalloc-with-gdbs-python-api/

There are no APIs for that. It should be possible to script gdb to locate things in core file. If you do that, please consider contributing this back.

yes sure. we wanted to know the location of the central heap or main arena and from there how to reach the thread cache. is the central heap at a fixed location ?

It's not very straightforward. I'll try to give you some pointers, but doing this thing will require you to understand intimate details tcmalloc. So you'll need to dive into the code in any case.
There are several data structures that represent freed memory and metadata.
PageMap stores mapping from logical pages (8k or 32k or 64k depending on config) to Span objects. Which store metadata for that chunk of memory.
Spans that are free are kept in pageheap. Pageheap and pagemap can be located via static_vars.h.
Every thread has ThreadCache that maintains free list per size class. There is global list of them headed at ThreadCache::thread_heaps_.
And there is also CentralFreeList object that maintains transfer caches and free lists per size class.
By analyzing all that data when program is stopped, you can in locate all free and allocated objects.


[SPARK-35326][BUILD][FOLLOWUP] Update dependency manifest files

What changes were proposed in this pull request?
This is a followup of https://github.com/apache/spark/pull/32453.
Why are the changes needed?
Jenkins doesn't check dependency manifest files.
Does this PR introduce any user-facing change?
No.
How was this patch tested?
Pass the GitHub Action or manually.

Could you review this, @sarutak and @viirya ?

Test build #138215 has started for PR 32458 at commit 724a896.

@dongjoon-hyun Thank you for following up. I run dev/test-dependencies.sh --replace-manifest on my laptop and got the same result so LGTM.

Gentle ping, @sarutak !

Thank you!

lgtm

Thank you, @viirya !

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42737/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42737/

Test build #138215 has finished for PR 32458 at commit 724a896.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138215/


Field OrderItem.quantity must be of same type as CartItem.quantity

when starting django pipenv :
django.core.management.base.SystemCheckError: SystemCheckError: System check identified some issues:
ERRORS:
?: Field `OrderItem.quantity` must be of same type as `CartItem.quantity`.

Seems that you are mixing the merchant implementation created by cookiecutter-django-shop for version 1.1 with django-shop version 1.0. The Pipfile in your merchant implementation wants https://github.com/awesto/django-shop/archive/releases/1.1.x.zip , so please recheck.

Please note that in version 1.1 the default CartItem.quantitychanged from IntegerField to PositiveIntegerField. So just fix your OrderItem.quantity to the same type.

Sorry @stilet , this change was scheduled for version 1.1, but unfortunately slipped into version 1.0.1. If you want I can create a fix and release that as 1.0.2, however in 1.1 is changes again.

Thanks it's not urgent :+1:   - I'm just starting to deal with django-shop

In version 1.0.2 it has been fixed.


Update PersistentThrust.netkan

Plugin has been tested to work in KSP 1.0.5

Merging with my thanks


Calculate node size from content

The current graph layout algorithm (#3) is naive in that it assumes interactions and options are all static size (300x300px and 100x300px respectively). However, node size can vary based on what they contain (eventually, presumably), so the sizes should be read from the DOM.
The components in question are EditInteraction and EditOption. I'll make some way to share the functionality between them, possibly a mixin or something imported into setup - the specifics don't matter. What does matter is how I get the information back to the layout engine.
The layout engine does what it needs to and then shits the result out onto the canvas and then forgets about it. In the future it'll be re-called each time the graph changes, but I'm not at that stage yet (although I did already add a watchEffect which might do it already - not tested). Critically, there's no binding of the edit components back to the data - they just have specific update events configured that echo any changes upwards.
I think possibly a good solution would be to pass the ID (or pseudo-ID in the case of options) of the node as a prop to the component - or if not a prop, at least an attribute. Then I should be able to read the components in order and know exactly which data point they refer to. (EDIT: I can just use the iteration key for this, right?)
A difficulty I might have there is getting that information back to the layout engine. It currently handles all forms of layout, both sizing and positioning. I would need to defer sizing to Vue and the browser, let it calculate that, and then take that information and give it to ELK to calculate the positioning. Splitting up the layouting like that is not going to be intuitive. There might be a good reason that Twine assumes all of its nodes are square.

It works!

One new problem is that the nodes on each layer of the graph are vertically centred. This could cause problems when one interaction is much longer than others in the same layer. It could also cause problems for edges, which could become obscenely long when a single interaction is long enough to extend the layer in such a way that's unnecessary for other interactions in that layer. A pure layered algorithm might not be the best solution, but I'm not sure what else I could use.
ELK provides a Layout Partitioning feature. However, layout partitions have to be done 'manually'. I could possibly sort nodes into partitions based on their length, assuming the feature even does what I think it will.
Will have to see if this becomes problematic in the future. It might not.


Edit of TestRun CRD during the test

Currently editing of TestRun while the test is running or even after it has finished is not supported. To be precise, one can edit it if they want but they shouldn't as that
a) will likely not result in the expected change of behaviour if it happens while the test is running;
b) may lead to failures while the test is running;
c) won't do anything if it happens after the test run has finished.
While the test run is running
Executing apply of yaml with the same name and namespace but different options in the middle of the test run will result in message testrun.k6.io/k6-sample configured and then the controller's logic can become broken. E.g. if one increases parallelism, then the controller is stuck waiting. If parallelism decreases, it might "survive" in OSS usage but not change number of runners. In Cloud usage, it may lead to additional failures.
Similarly, modification of the CR during test run execution will result in message testrun.k6.io/k6-sample edited and the same issues as above.
When the test run has finished
Edits of CRD won't have any impact at all.
Opening this issue as a follow-up from #138. Feedback and thoughts are welcome.

Updated the issue description to take into account the use case described in #312


🎁: Add CPCL for checklists in HT

Expected outcome
There are also some C-tests(ELE19,3) in OGP that are CPCLs so we need to enable CPCL for the sidesheet. And then also add a column to show which are MCCRs and which are CPCLs

[ ] Remove filter on CPCL in View
[ ] Add column in HT sidesheet for Form Group

Fixed in view - will be out in production on tuesday.
@MagnusGjosund  can you add the column "FormularGroup" in sidesheet of HT?

This is done, closing this issue.


Feat: OSD

Describe the bug
it stop showing OSD when we try to increase/decrease volume/brightness rapidy
Reproduction
..
System Info
.

Validations

[X] Follow our Code of Conduct
[X] Read the Contributing Guide.
[X] Check that there isn't already an issue that reports the same bug to avoid creating a duplicate.
[X] Check that this is a concrete bug. For Q&A, please open a GitHub Discussion instead.
[X] The provided reproduction is a minimal reproducible of the bug.

done


EntityManager::getReference() can return null

When the requested class has subclasses, a proxy cannot be returned, and the entity has to be loaded from the DB to figure out its actual class:
https://github.com/doctrine/doctrine2/blob/13f838f8bed021cc67e564ec1ff6e994a1a499a8/lib/Doctrine/ORM/EntityManager.php#L498-L500
Because find() is used, if the entity doesn't exist, EntityManager::getReference() therefore returns null.
I think that either:

the return type of EntityManagerInterface::getReference() should be object|null
or EntityManager::getReference() should throw an ORMException when the id doesn't exist

This is a PR for the first proposal, but if you prefer the second approach (BC break?) I can change the PR.

getReference() is a similar method as find() and should have the same behaviour. I think null should be okay.

@BenMorel it doesn't make much sense to thrown an exception, also because:
https://github.com/doctrine/doctrine2/blob/13f838f8bed021cc67e564ec1ff6e994a1a499a8/lib/Doctrine/ORM/EntityManager.php#L494-L496
So I'd say we simply forgot to add |null on the interface, but maybe @Ocramius or @guilhermeblanco could give us some historical context here.

Yeah, this should be an |null
On 9 Oct 2017 17:35, "Luís Cobucci"<EMAIL_ADDRESS>wrote:

@BenMorel https://github.com/benmorel it doesn't make much sense to
thrown an exception, also because:
https://github.com/doctrine/doctrine2/blob/13f838f8bed021cc67e564ec1ff6e9
94a1a499a8/lib/Doctrine/ORM/EntityManager.php#L494-L496
So I'd say we simply forgot to add |null on the interface, but maybe
@Ocramius https://github.com/ocramius or @guilhermeblanco
https://github.com/guilhermeblanco could give us some historical
context here.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/doctrine/doctrine2/pull/6755#issuecomment-335194733,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAJakOf6ZvwIIvcBppF-kbvZTr4Zp1mdks5sqj02gaJpZM4PuVFS
.

@BenMorel 🚢


use floor and ceil to ensure int bounds

Bound calculations are not guaranteed to give integers, so convert before making an intvar

Which bugs does this tackle? I also saw the same thing in PR #454, so I guess you encountered, but I am not sure which get_bounds can return non ints.

One more thing; can you check whether it is non-integer, and in that case throw a warning? or is that excessive?

I don't think there will ever be a surprise float appearing without the user writing it? Maybe a warning that we only have intvars and not realvars makes sense


⚠ Nebulance has degraded performance

In ea76831, Nebulance ($NBL) experienced degraded performance:

HTTP code: 200
Response time: 1174 ms

Resolved: Nebulance performance has improved in 033a5b9 after 8 minutes.


serial: Add --device virtio-serial,pty support

This new virtio-serial option allocates a pseudo-tty for the VM console. It
can then be accessed using screen for example. This is a bit similar to
the --device virtio-serial,stdio option, except that the console is not
tied to the terminal running vfkit, it's possible to connect/disconnect
from the pseudo-tty from any terminal.
This fixes https://github.com/crc-org/vfkit/issues/48

tested and working as expected..
% ./out/vfkit \
    --cpus 2 --memory 2048 \
    --bootloader efi,variable-store=efi-variable-store,create \
    --device virtio-blk,path=vfkit-test-image.raw --device virtio-serial,pty
INFO[0000] &{2 2048    {[efi variable-store=efi-variable-store create] true}  [virtio-blk,path=vfkit-test-image.raw virtio-serial,pty] none://  false}
INFO[0000] boot parameters: &{EFIVariableStorePath:efi-variable-store CreateVariableStore:true}
INFO[0000]
INFO[0000] virtual machine parameters:
INFO[0000] 	vCPUs: 2
INFO[0000] 	memory: 2048 MiB
INFO[0000]
INFO[0000] Adding virtio-blk device (imagePath: vfkit-test-image.raw)
INFO[0000] Using PTY (pty path: /dev/ttys002)
INFO[0000] virtual machine is running
INFO[0000] waiting for VM to stop

after this i was able to see the fedora login prompt by running % screen /dev/ttys002

/lgtm

I am testing it with crc bundle with the script part of contrib/script with following change but not able to get any login prompt
$ git diff
diff --git a/contrib/scripts/start-crc-bundle.sh b/contrib/scripts/start-crc-bundle.sh
old mode 100644
new mode 100755
index 34a28ee..965a497
--- a/contrib/scripts/start-crc-bundle.sh
+++ b/contrib/scripts/start-crc-bundle.sh
@@ -15,6 +15,6 @@ cp -c ${BUNDLE_PATH}/${DISKIMG} overlay.img
     --initrd "${BUNDLE_PATH}/${INITRD}" \
     --kernel-cmdline "${CMDLINE}" \
     --device virtio-blk,path=overlay.img \
-    --device virtio-serial,logFilePath=start-bundle.log \
+    --device virtio-serial,pty \
     --device virtio-net,nat,mac=72:20:43:d4:38:62 \
     --device virtio-rng

$ contrib/scripts/start-crc-bundle.sh /Users/prkumar/.crc/cache/crc_vfkit_4.13.14_arm64
[...]
INFO[0000]
INFO[0000] virtual machine parameters:
INFO[0000] 	vCPUs: 2
INFO[0000] 	memory: 2048 MiB
INFO[0000]
INFO[0000] Adding virtio-blk device (imagePath: overlay.img)
INFO[0000] Using PTY (pty path: /dev/ttys000)            <= tried to connect this with screen and nothing
INFO[0000] Adding virtio-net device (nat: true macAddress: [72:20:43:d4:38:62])
INFO[0000] Adding virtio-rng device
INFO[0000] virtual machine is running
INFO[0000] waiting for VM to stop

I will try with fedora also same what @anjannath tested and put another comment.

To me even steps mentioned by @anjannath didn't work after screen /dev/ttys000 I just see the blank without any prompt.

I tried again and it is working for me still, maybe you have to attach to the pty quickly otherwise you miss the login prompt and it doesn't re-appear?
https://github.com/crc-org/vfkit/assets/8885742/befe219b-cbc4-42ca-b8a5-3da6e50deafc
but another thing i noticed is that the keyboard only works sometimes, a few times (2 out of 4 runs) during testing keys are not echoed in screen, which i assumed to be the keyboard not working

maybe you have to attach to the pty quickly otherwise you miss the login prompt and it doesn't re-appear?

I also tried to attach pty quickly but still nothing, waiting more that 5 mins.

but another thing i noticed is that the keyboard only works sometimes, a few times (2 out of 4 runs) during testing keys are not echoed in screen, which i assumed to be the keyboard not working

So after 5-6 retry finally I am able to get the login prompt for fedora and crc bundle but then on crc I am not able to use the keyboard but on fedora able to do.

but another thing i noticed is that the keyboard only works sometimes, a few times (2 out of 4 runs) during testing keys are not echoed in screen, which i assumed to be the keyboard not working

So after 5-6 retry finally I am able to get the login prompt for fedora and crc bundle but then on crc I am not able to use the keyboard but on fedora able to do.

Maybe virtio: Simplify setRawMode is causing issues. Or maybe it would be better to use https://github.com/pkg/term/blob/1a4a3b719465afccedae7788469c0b54a43417e0/termios/termios.go#L41-L50 , but I could not get this to work correctly.
Really not familiar with pty/terminal input/output :-/

but another thing i noticed is that the keyboard only works sometimes, a few times (2 out of 4 runs) during testing keys are not echoed in screen, which i assumed to be the keyboard not working

So after 5-6 retry finally I am able to get the login prompt for fedora and crc bundle but then on crc I am not able to use the keyboard but on fedora able to do.

Maybe virtio: Simplify setRawMode is causing issues. Or maybe it would be better to use https://github.com/pkg/term/blob/1a4a3b719465afccedae7788469c0b54a43417e0/termios/termios.go#L41-L50 , but I could not get this to work correctly. Really not familiar with pty/terminal input/output :-/

I am also not sure what causing the issue but as of now this functionality is quite buggy and we might not able to consume it when required like debugging an broken ssh connection. Do you think we can use tty along with log to a file because in tty I also don't see boot logs ?


[Bug] Newer versions not working

Device
Laptop
Operating System
Other
Browser
Chrome/Edge/Chromium
Browser Version
124
Better xCloud Version
4.3.0
Reproduction Steps
The newer versions of Better Xcloud don't seem to work on my Chromebook. I click on the games and it does nothing.
I have to use 1.11 to even get it to work at all. I'm assuming this has something to do with my Laptop being ancient but I figured i'd try anyways.

Does it work with Bx turned off?  Check Console tab of Chrome DevTools for error logs: https://developer.chrome.com/docs/devtools/

Sorry I'm pretty new to this, how exactly would I go about turning that off?

Turn it off in the Tampermonkey dashboard

Only two errors I got are.
userscript.html?name=Better-xCloud.user.js&id=fa6e000a-e6a8-492b-82ff-f1b5b833f369:10772 Uncaught ReferenceError: structuredClone is not defined
at set (userscript.html?name=Better-xCloud.user.js&id=fa6e000a-e6a8-492b-82ff-f1b5b833f369:10772)
at play:246
and
[Intervention] Blocked call to navigator.vibrate because user hasn't tapped on the frame or any embedded frame yet: https://www.chromestatus.com/feature/5644273861001216.

structuredClone is not defined. This is most likely because something's wrong with your browser. If you're really using Chrome 124 then it should work.

Strange i'll try reinstalling chrome then.


If the XML file is saved by UTF-8 encoding , Chinese garbled characters

If the XML file is saved by ANSI encoding, the Chinese character is normal .If the XML file is saved by UTF-8 encoding , Chinese garbled characters .How to solve it .
如果xml文件以utf-8编码格式保存，解析出来的中文字符是乱的；如果以ANSI编码格式保存xml文件，解析出来的字符正常。请问如何解决以utf-8编码格式保存的xml文件的乱码问题？

There is no option for ANSI. TinyXML-2 only inputs and outputs UTF-8.


[BUG]  lint executor options fixWhitespace and fixStyle provides invalid options to dotnet format (when > SDK 6.0.203)

Current Behavior

Usage has changed:
https://github.com/dotnet/format/issues/1268
Unfortunately, it looks to be all (whitespace, style, analyzers) enabled by default or else it requires individual calls.
Context:

We've been trying to use csharpier (prettier inspired formatter for C#) and it isn't playing well with dotnet format.
The goal was to disable whitespace

Expected Behavior
Expected fixWhitespace: false, fixStyle:"info" to invoke dotnet format style {...}
Based on the dotnet format cli:

multiple calls to dotnet format may be needed to fulfill some permutations.
severity needs to be provided separately
analyzer is a seperate option

Github Repo
No response
Steps to Reproduce

nx-dotnet/core:library generator (defaults to .net 7 for me -- version of dotnet cli is installed?)
Add options: {  fixWhitespace: true, fixStyle: warn}
nx lint {project}

Nx Report
 nx-trends  nx report

 >  NX   Report complete - copy this into the issue template

   Node : 16.13.2
   OS   : win32 x64
   npm  : 8.17.0

   nx : 15.6.2
   @nrwl/angular : 15.6.2
   @nrwl/cypress : 15.6.2
   @nrwl/detox : Not Found
   @nrwl/devkit : 15.6.2
   @nrwl/esbuild : Not Found
   @nrwl/eslint-plugin-nx : 15.6.2
   @nrwl/expo : Not Found
   @nrwl/express : Not Found
   @nrwl/jest : 15.6.2
   @nrwl/js : 15.6.2
   @nrwl/linter : 15.6.2
   @nrwl/nest : Not Found
   @nrwl/next : Not Found
   @nrwl/node : Not Found
   @nrwl/schematics : Not Found
   @nrwl/storybook : Not Found
   @nrwl/web : Not Found
   @nrwl/webpack : 15.6.2
   @nrwl/workspace : 15.6.2
   @nrwl/vite : Not Found
   typescript : 4.8.4
   ---------------------------------------
   Local workspace plugins:
   ---------------------------------------
   Community plugins:
         @ngrx/component: 15.2.1
         @ngrx/component-store: 15.2.1
         @nx-dotnet/core: 1.19.1
         @trumbitta/nx-plugin-openapi: 1.12.1

nx.json
{
    "plugins": ["@nx-dotnet/core"],
    "npmScope": "nx-trends",
    "namedInputs": {
        "default": ["{projectRoot}/**/*", "sharedGlobals"],
        "production": [
            "default",
            "!{projectRoot}/**/?(*.)+(spec|test).[jt]s?(x)?(.snap)",
            "!{projectRoot}/tsconfig.spec.json",
            "!{projectRoot}/jest.config.[jt]s",
            "!{projectRoot}/.eslintrc.json",
            "!{projectRoot}/cypress/**/*",
            "!{projectRoot}/**/*.cy.[jt]s?(x)",
            "!{projectRoot}/cypress.config.[jt]s"
        ],
        "sharedGlobals": []
    },
    "targetDefaults": {
        "build": {
            "dependsOn": ["^build", "codegen", "^codegen"],
            "inputs": ["production", "^production"]
        },
        "test": {
            "inputs": [
                "default",
                "^production",
                "{workspaceRoot}/jest.preset.js"
            ]
        },
        "e2e": {
            "inputs": ["default", "^production"]
        },
        "lint": {
            "inputs": ["default", "{workspaceRoot}/.eslintrc.json"]
        },
        "component-test": {
            "inputs": ["default", "^production"]
        }
    },
    "tasksRunnerOptions": {
        "default": {
            "runner": "@nrwl/nx-cloud",
            "options": {
                "cacheableOperations": [
                    "build",
                    "lint",
                    "test",
                    "e2e",
                    "codegen",
                    "target",
                    "component-test"
                ],
                "accessToken": "REDACTED"
            }
        }
    },
    "affected": {
        "defaultBase": "master"
    },
    "generators": {
        "@nx-dotnet/core:application": {
            "language": "C#",
            "template": "webapi",
            "testTemplate": "xunit"
        },
        "@nx-dotnet/core:library": {
            "language": "C#",
            "template": "classlib",
            "testTemplate": "xunit"
        },
        "@nrwl/angular:application": {
            "style": "scss",
            "linter": "eslint",
            "unitTestRunner": "jest",
            "e2eTestRunner": "cypress",
            "addTailwind": true,
            "standalone": true,
            "inlineTemplate": true,
            "inlineStyle": true,
            "skipTests": true
        },
        "@nrwl/angular:library": {
            "style": "scss",
            "linter": "eslint",
            "unitTestRunner": "jest",
            "skipModule": "true",
            "skipTests": true
        },
        "@nrwl/angular:component": {
            "style": "scss",
            "standalone": true,
            "changeDetection": "OnPush",
            "inlineTemplate": true,
            "inlineStyle": true,
            "flat": true,
            "skipTests": true
        }
    }
}

Failure Logs
No response
Additional Information
No response

Related question, how would one tie formatting into nx format:write instead of  lint?   I assume formatting was a side-effect of the lint rather than the intention here?

The command nx format:write is not overridable, which is why we chose to use the lint target instead. Just like with ESLint in a JavaScript workspace, the lint command here verifies that everything is compliant with the workspace formatting and workspace analyzers. By default, the command will not change any of your files. If you did want it to change your files, you could add the --fix flag, just like you could with ESLint.
I know this doesn't solve your bug, but hopefully it answers your question about why it works this way.

Ugh. I still hate the way they went about integrating dotnet format into the SDK. There was no reason that should have been breaking.
Alas, we should handle this. I'll look into it whenever I am able.


skip wait_for in reboot handler ( for ansible-pull )

The handler to reboot has a "wait_for" - this needelessly makes this role pause for 300s before rebooting - also when ansible-pull is running. Can we skip that one somehow on ansible-pull runs?
For push mode then it's nice to keep this one as the play shouldn't fail - just reboot and then wait for the node to come back online.
https://github.com/CSC-IT-Center-for-Science/ansible-role-cuda/blob/master/handlers/main.yml

As far as I can see there's no special variable in ansible_facts one could use to figure out if we are running ansible-pull. So instead we set a variable when running ansible-pull.
Conditional updated for the wait_for handler in https://github.com/CSC-IT-Center-for-Science/ansible-role-cuda/commit/e1af63b9373078f8684ba671f9182738193606f8

Testing the change on our GPU node

Not perfect. It didn't restart at all now after the cuda role on a new install.
Maybe one needs to remove the async/poll settings in the handler.

The wait_for does not apply anymore. Also added a handler 1 and task 2 which runs cuda_init.sh in ansible too (not only from rc.local). But after the file has changed or if /dev/nvidia0 does not exist. Idea here is to have a /dev/nvidia0 available on the GPU nodes before we start slurm (which fails if those files in gres.conf does not exist).


[FLINK-24786][state] Introduce and expose RocksDB statistics as metrics

What is the purpose of the change
Introduce and expose RocksDB statistics as metrics.
Brief change log

Introduce RocksDB statistics based metrics.
Expose these native metrics via RocksDBNativeMetricMonitor.

Verifying this change
This change added tests and can be verified as follows: RocksDBNativeMetricMonitorTest.
Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): no
The public API, i.e., is any changed class annotated with @Public(Evolving): no
The serializers: no
The runtime per-record code paths (performance sensitive): no
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no
The S3 file system connector: no

Documentation

Does this pull request introduce a new feature? yes
If yes, how is the feature documented? docs

LGTM

@flinkbot run azure

@flinkbot run azure

@masteryhx Thanks for the review, and I will merge this PR since the CI is green finally.


Error opening files in split view

When I'm using split view with some kind of files in different tabs for a long time it's becomes glitchy with files.
For example: I have 3 files 1.css 2.css 3.css in two tabs. When I select 1.css from tab it select 1.css, brackets shows right filename and path in top of panel but I see in code content of 2.css. And if I save this file it saves content of 2.css to 1.css. Restarting brackets with cmd+R doesn't help. Only close brackets full and open again
Brackets sprint 6 build 1.6.0-16680 (release 3df0ac6fa)
Mac OS X 10.11.3

Duplicate of / related to https://github.com/adobe/brackets/issues/12162

@petetnt, thanks

A build refresh is scheduled by his week or next for 1.6 and after that the new installers posted will contain this fix.
Closing as fixed.


[reg] Fix shadow reg update during storage error

Fixes #7764
Do not allow register upates once storage errors occur.
This effectively makes the storage error persistent.

Signed-off-by: Timothy Chen<EMAIL_ADDRESS>

@cindychip sorry this is landing so late, but can you let me know if this addresses the issue?


CMD_TERMINATOR and MAX_BUF_SIZE should surround with #ifndef

let CMD_TERMINATOR can be define externally instead of  modify directly cli_defs.h
and  add a newline  to clear warning:
deps\embedded-cli\cli.h(91): warning:  #1-D: last line of file ends without a newline

Fixed in 8d387dd836ca5b73320135d502781bf56752cf29


Include original OAuth error in LTIExceptions

Currently LTIException raised in response to OAuth errors don't include the original error. This patch includes the original error and maintains the stack trace to simplify debugging.

Sorry this has been sitting unattended for so long @wolever but it's failing PEP8 tests.
/home/travis/build/mitodl/pylti/pylti/common.py:310:47: E225 missing whitespace around operator

        raise LTIException("OAuth error: %s" %(e.message, )), None, sys.exc_info()[2]

                                              ^

/home/travis/build/mitodl/pylti/pylti/common.py:310:80: E501 line too long (85 > 79 characters)

        raise LTIException("OAuth error: %s" %(e.message, )), None, sys.exc_info()[2]


CLI drop database modified to address in case the database doesn't exist

If you run vms database drop when the database is not existing, it results in sqlalchemy.exc.ProgrammingError. This is just a minor fix to give a better CLI experience.

LGTM, thanks for the PR!

Thanks for letting me contribute

Merging